Porsche Active Sensing Cockpit
Porsche Active Sensing Cockpit
Porsche Active Sensing Cockpit
Category
Automotive UX Strategy
Time
Jan - May 2025
Team
Jerry Cai
Yilin Jin
Jason Jiang
Brayana Lee
My Role
Product R&D
HMI Design
3D Visualization
Physical Prototyping
An Automotive Cockpit that harmonizes Porsche’s performance DNA with family well-being. Utilizing multi-modal sensing and proactive AI assitance, the vehicle anticipates passenger needs before they are spoken, from emergency medical response to emotional care, creating a cabin experience that is safe, calm, and intuitively in control.
An Automotive Cockpit that harmonizes Porsche’s performance DNA with family well-being. Utilizing multi-modal sensing and proactive AI assitance, the vehicle anticipates passenger needs before they are spoken, from emergency medical response to emotional care, creating a cabin experience that is safe, calm, and intuitively in control.
An Automotive Cockpit that harmonizes Porsche’s performance DNA with family well-being. Utilizing multi-modal sensing and proactive AI assitance, the vehicle anticipates passenger needs before they are spoken, from emergency medical response to emotional care, creating a cabin experience that is safe, calm, and intuitively in control.
Research
Research
This is a team project from a sponsor-based studio with regular design critiques from Volkswagen Group Product Design mentors. Our four-person, cross-disciplinary team included one Industrial Designer and one Transportation Designer and two Product Designers.
This is a team project from a sponsor-based studio with regular design critiques from Volkswagen Group Product Design mentors. Our four-person, cross-disciplinary team included one Industrial Designer and one Transportation Designer and two Product Designers.
This is a team project from a sponsor-based studio with regular design critiques from Volkswagen Group Product Design mentors. Our four-person, cross-disciplinary team included one Industrial Designer and one Transportation Designer and two Product Designers.
My Role
My Role
My Role
Product Designer & Team Lead, driving product vision and leading UX Design while coordinating final execution
Product Designer & Team Lead, driving product vision and leading UX Design while coordinating final execution
Product Designer & Team Lead, driving product vision and leading UX Design while coordinating final execution
Brand Research
Brand Research
SUV Majority
59% of Porsche’s 2022 deliveries were SUVs, making the EV-SUV the highest-impact place to rethink UX.
59% of Porsche’s 2022 deliveries were SUVs, making the EV-SUV the highest-impact place to rethink UX.
59% of Porsche’s 2022 deliveries were SUVs, making the EV-SUV the highest-impact place to rethink UX.
Software Defined
57% EV buyers would switch brands for better connectivity smart EV are becoming standard.
57% EV buyers would switch brands for better connectivity smart EV are becoming standard.
57% EV buyers would switch brands for better connectivity smart EV are becoming standard.
VW’s Software Investment
$5B+ investment in EV software and connectivity from VW Group’s signals an urgent software update.
$5B+ investment in EV software and connectivity from VW Group’s signals an urgent software update.
$5B+ investment in EV software and connectivity from VW Group’s signals an urgent software update.
Strategic Direction
Strategic Direction
Research shows SUV dominance and rising smart-EV demand; with no three-row EV, we add a Prestige 6/7-seat flagship above the current Cayenne/Macan Lineup and set the strategy below.
Research shows SUV dominance and rising smart-EV demand; with no three-row EV, we add a Prestige 6/7-seat flagship above the current Cayenne/Macan Lineup and set the strategy below.
Demographics Research
Demographics Research
We used secondary research on current Cayenne demographics to project the demographics for the vision model.
We used secondary research on current Cayenne demographics to project the demographics for the vision model.
We used secondary research on current Cayenne demographics to project the demographics for the vision model.
Persona
Persona
Painpoints
Painpoints
Limited Intelligence
Limited Intelligence
Family Safety Concerns
Family Safety Concerns
High Cognitive Overload
High Cognitive Overload
Fragmented experience
Fragmented experience
How might we transform the vehicle from passive security into a proactive guardian that reduces mental load for parents while actively monitoring and securing the family's health during journey?
Design Opportunities
Design Opportunities
We identified pain points and ecosystem gaps, translating them into three opportunity areas.
We identified pain points and ecosystem gaps, translating them into three opportunity areas.
We identified pain points and ecosystem gaps, translating them into three opportunity areas.
Proactive AI Assistance
To bridge the gap between user intent and system action. We envisioned a cockpit that doesn't just wait for commands but actively understands context. By automating comfort and safety adjustments based on real-time sensing, the vehicle creates a fluid experience that taken care every moment .
To bridge the gap between user intent and system action. We envisioned a cockpit that doesn't just wait for commands but actively understands context. By automating comfort and safety adjustments based on real-time sensing, the vehicle creates a fluid experience that taken care every moment .
To bridge the gap between user intent and system action. We envisioned a cockpit that doesn't just wait for commands but actively understands context. By automating comfort and safety adjustments based on real-time sensing, the vehicle creates a fluid experience that taken care every moment .
Medical Assist & V2E
Monitors in-cabin vitals and, if Emergency Mode is activated, notify ER and auto driving to hospital if needed and securely shares real-time vitals and key Family Health Profile details.
Monitors in-cabin vitals and, if Emergency Mode is activated, notify ER and auto driving to hospital if needed and securely shares real-time vitals and key Family Health Profile details.
Monitors in-cabin vitals and, if Emergency Mode is activated, notify ER and auto driving to hospital if needed and securely shares real-time vitals and key Family Health Profile details.
Car Home Ecosystem
Links your vehicle with your smart home and proactively offers control suggestions while you drive, reducing mental load and making arrivals calmer and safer for the whole family.
Links your vehicle with your smart home and proactively offers control suggestions while you drive, reducing mental load and making arrivals calmer and safer for the whole family.
Links your vehicle with your smart home and proactively offers control suggestions while you drive, reducing mental load and making arrivals calmer and safer for the whole family.
Proactive AI Assistance
Proactive AI Assistance
Research Setup
Research Setup
Participants:
Participants:
Method:
Method:
Demographic Location:
Demographic Location:
Key Metrics：
Key Metrics：
Participants:
Participants:
30+ EV family users in the U.S.
30+ EV family users in the U.S.
Flow State Survey & Interviews
Flow State Survey & Interviews
Greater LA Area
Greater LA Area
Trust Level & Flow Short Scale
Trust Level & Flow Short Scale
Understand driving routines and attitudes toward Proactive Assistance
Understand driving routines and attitudes toward Proactive Assistance
150 Million +
75%
Feel current EV UX isn’t intelligent enough for daily use.
Feel current EV UX isn’t intelligent enough for daily use.
Feel current EV UX isn’t intelligent enough for daily use.
73%
Hope intelligence that learns personal preferences and context.
Hope intelligence that learns personal preferences and context.
Hope intelligence that learns personal preferences and context.
86%
Express clear concerns about privacy and data permissions.
Express clear concerns about privacy and data permissions.
Express clear concerns about privacy and data permissions.
Data Privacy Challenge
Data Privacy Challenge
Data Privacy Challenge
How might we build a hyper-sensing cockpit that delivers deep personalization without crossing the line into surveillance?
How might we build a hyper-sensing cockpit that delivers deep personalization without crossing the line into surveillance?
How might we build a hyper-sensing cockpit that delivers deep personalization without crossing the line into surveillance?
Solution - Privacy-First AI Assistance Architecture
Solution - Privacy-First AI Assistance Architecture
This diagram illustrates the data journey from Multimodal Sensing to Intelligent Suggestion. By adopting a local-first approach, the system processes sensitive physiological signals on the edge. It only accesses cloud capabilities when necessary and authorized, balancing the need for powerful AI with strict data security
This diagram illustrates the data journey from Multimodal Sensing to Intelligent Suggestion. By adopting a local-first approach, the system processes sensitive physiological signals on the edge. It only accesses cloud capabilities when necessary and authorized, balancing the need for powerful AI with strict data security
Trust & Data Controls
Trust & Data Controls
I designed four privacy modes integrated into the car settings. Users can switch among Privacy, Standard, Proactive, and Personalization with one tap, or personalize per seat with precise sensor permissions and data-retention rules.
I designed four privacy modes integrated into the car settings. Users can switch among Privacy, Standard, Proactive, and Personalization with one tap, or personalize per seat with precise sensor permissions and data-retention rules.
Proactive AI suggestions and sensors are deactivated for incognito location tracking, but emergency calling remains active
Proactive AI suggestions and sensors are deactivated for incognito location tracking, but emergency calling remains active
User Scenario
User Scenario
This system bridges a key gap we found in research. By sensing and visualizing shared emotional states, it helps families manage stress on the road and lays the groundwork for more empathetic, intelligent in-cabin experiences.
This system bridges a key gap we found in research. By sensing and visualizing shared emotional states, it helps families manage stress on the road and lays the groundwork for more empathetic, intelligent in-cabin experiences.
This system bridges a key gap we found in research. By sensing and visualizing shared emotional states, it helps families manage stress on the road and lays the groundwork for more empathetic, intelligent in-cabin experiences.
Family trip to Yosemite!
Family trip to Yosemite!
A family of four is on a road trip. Dad is driving the car in the front, mom is sitting in the front, kids sit in the back.
A family of four is on a road trip. Dad is driving the car in the front, mom is sitting in the front, kids sit in the back.
A family of four is on a road trip. Dad is driving the car in the front, mom is sitting in the front, kids sit in the back.
Mood Monitoring
Mood Monitoring
The bottom screen continuously visualizes each passenger’s mood in real time.
The bottom screen continuously visualizes each passenger’s mood in real time.
The bottom screen continuously visualizes each passenger’s mood in real time.
Restless child needs to use the restroom
Restless child needs to use the restroom
Kids wants to pee and starts to become restless and distractions.
Kids wants to pee and starts to become restless and distractions.
Kids wants to pee and starts to become restless and distractions.
Detect Mood Changing
Without needing to verbalize the issue, their seat indicator gradually shifts color—signaling rising anxiety. This passive detection allows the system to surface needs that might otherwise go unnoticed.
Without needing to verbalize the issue, their seat indicator gradually shifts color—signaling rising anxiety. This passive detection allows the system to surface needs that might otherwise go unnoticed.
Without needing to verbalize the issue, their seat indicator gradually shifts color—signaling rising anxiety. This passive detection allows the system to surface needs that might otherwise go unnoticed.
Mood Escalation Triggers Visual Alert
Without needing to verbalize the issue, their seat indicator gradually shifts color—signaling rising anxiety. This passive detection allows the system to surface needs that might otherwise go unnoticed.
Without needing to verbalize the issue, their seat indicator gradually shifts color—signaling rising anxiety. This passive detection allows the system to surface needs that might otherwise go unnoticed.
Without needing to verbalize the issue, their seat indicator gradually shifts color—signaling rising anxiety. This passive detection allows the system to surface needs that might otherwise go unnoticed.
Medical Assist & V2E
Medical Assist & V2E
Research
Research
During the survey and the interview we notify that out of 90% response express concern about safety and it is not about of safety like collision it is about emergency circumstances.
During the survey and the interview we notify that out of 90% response express concern about safety and it is not about of safety like collision it is about emergency circumstances.
During the survey and the interview we notify that out of 90% response express concern about safety and it is not about of safety like collision it is about emergency circumstances.
−10% / min
Drop in survival probability for every minute of delay
25 min
Faster reperfusion achieved via digital ECG pre-alert
Faster reperfusion achieved via digital ECG pre-alert
Faster reperfusion achieved via digital ECG pre-alert
Competitive Analyze
Competitive Analyze
Onstar Emergency Services
Onstar Emergency Services
High reliance on manual intervention
High reliance on manual intervention
Users need to verbally describe the situation, with no real-time biometric data sharing—often resulting in imprecise or delayed responses
Users need to verbally describe the situation, with no real-time biometric data sharing—often resulting in imprecise or delayed responses
Traditional systems still depend on external ambulance services, which are often slow and costly
Traditional systems still depend on external ambulance services, which are often slow and costly
The Emergency Protocol
The Emergency Protocol
The system operates on a clear three-step logic: it monitors occupant status via sensors, syncs necessary health data to the cloud, and connects directly to emergency services to bridge the gap between detection and rescue
The system operates on a clear three-step logic: it monitors occupant status via sensors, syncs necessary health data to the cloud, and connects directly to emergency services to bridge the gap between detection and rescue
Emergency User Scenario
This system bridges a key gap we found in research. By sensing and visualizing shared emotional states, it helps families manage stress on the road and lays the groundwork for more empathetic, intelligent in-cabin experiences.
This system bridges a key gap we found in research. By sensing and visualizing shared emotional states, it helps families manage stress on the road and lays the groundwork for more empathetic, intelligent in-cabin experiences.
This system bridges a key gap we found in research. By sensing and visualizing shared emotional states, it helps families manage stress on the road and lays the groundwork for more empathetic, intelligent in-cabin experiences.
Passive Monitoring
Passive Monitoring
While cruising in L3 autonomy, the system passively constructs a real-time health baseline. It separates normal stress from critical anomalies without disturbing the driver's journey.
While cruising in L3 autonomy, the system passively constructs a real-time health baseline. It separates normal stress from critical anomalies without disturbing the driver's journey.
While cruising in L3 autonomy, the system passively constructs a real-time health baseline. It separates normal stress from critical anomalies without disturbing the driver's journey.
Proactive Intervention
Proactive Intervention
Detecting elevated heart rate and distress, the system automates the decision-making process. It gently takes control of the vehicle, initiates the SOS protocol, and guides the car to a safe shoulder stop.
Detecting elevated heart rate and distress, the system automates the decision-making process. It gently takes control of the vehicle, initiates the SOS protocol, and guides the car to a safe shoulder stop.
Detecting elevated heart rate and distress, the system automates the decision-making process. It gently takes control of the vehicle, initiates the SOS protocol, and guides the car to a safe shoulder stop.
Data Bridge &
Cognitive Relief
Data Bridge & Cognitive Relief
Data Bridge & Cognitive Relief
Data Bridge & Cognitive Relief
The vehicle establishes a secure V2X link to EMS, transmitting a concise "Medical Snapshot" (Vitals + Location). Inside, the UI simplifies to show only "Help is coming" and ETA, reducing the driver's panic.
The vehicle establishes a secure V2X link to EMS, transmitting a concise "Medical Snapshot" (Vitals + Location). Inside, the UI simplifies to show only "Help is coming" and ETA, reducing the driver's panic.
The vehicle establishes a secure V2X link to EMS, transmitting a concise "Medical Snapshot" (Vitals + Location). Inside, the UI simplifies to show only "Help is coming" and ETA, reducing the driver's panic.
Pre-Briefed Arrival & Seamless Handof
Pre-Briefed Arrival &
Seamless Handof
By providing pre-arrival data via C-V2X, the ambulance team is prepared for treatment immediately upon arrival, significantly closing the gap between the incident and effective medical intervention.
By providing pre-arrival data via C-V2X, the ambulance team is prepared for treatment immediately upon arrival, significantly closing the gap between the incident and effective medical intervention.
Car Home Ecosystem
Car Home Ecosystem
Smart Helmet
Links your vehicle with your smart home and proactively offers control suggestions while you drive, reducing mental load and making arrivals calmer and safer for the whole family.
Links your vehicle with your smart home and proactively offers control suggestions while you drive, reducing mental load and making arrivals calmer and safer for the whole family.
Links your vehicle with your smart home and proactively offers control suggestions while you drive, reducing mental load and making arrivals calmer and safer for the whole family.
Smart Home Scenario
Links your vehicle with your smart home and proactively offers control suggestions while you drive, reducing mental load and making arrivals calmer and safer for the whole family.
Links your vehicle with your smart home and proactively offers control suggestions while you drive, reducing mental load and making arrivals calmer and safer for the whole family.
Links your vehicle with your smart home and proactively offers control suggestions while you drive, reducing mental load and making arrivals calmer and safer for the whole family.
Proactive Suggestion
Multi-modal sensing detects Anna is drowsy in the rear seat.
Multi-modal sensing detects Anna is drowsy in the rear seat.
Multi-modal sensing detects Anna is drowsy in the rear seat.
Suggested actions: adjust Anna’s room A/C, dim hallway lights, and starts filling thebathtub.
Suggested actions: adjust Anna’s room A/C, dim hallway lights, and starts filling thebathtub.
Suggested actions: adjust Anna’s room A/C, dim hallway lights, and starts filling thebathtub.
Confirmation & Overview
After user taps Set, “Arrival Mode” is activated in the Home dashboard.
After user taps Set, “Arrival Mode” is activated in the Home dashboard.
Home dashboard displays full smart status for transparency and control.
Home dashboard displays full smart status for transparency and control.
Prototype Iteration
Prototype Iteration
Ideation Sketches
We first conduct rapid sketching defined the cockpit architecture and primary interaction zones—rooted in Porsche brand heritage and future-trend . Early studio critiques sharpened and aligned the UX hypothesis.
We first conduct rapid sketching defined the cockpit architecture and primary interaction zones—rooted in Porsche brand heritage and future-trend . Early studio critiques sharpened and aligned the UX hypothesis.
Cardboard Prototype
We then conduct the full-scale cardboard prototype to established ergonomic baselines: sightlines, reach envelopes, and control grouping—confirming a driver-centered layout before moving on to digital modeling.
We then conduct the full-scale cardboard prototype to established ergonomic baselines: sightlines, reach envelopes, and control grouping—confirming a driver-centered layout before moving on to digital modeling.
Interactive Prototype
We built a 3D digital twin and a low-fidelity clickable prototype, then ran task-based usability tests. We gain insights for streamlined the information architecture and interaction flows to lower cognitive load and reduce driver-distraction.
We built a 3D digital twin and a low-fidelity clickable prototype, then ran task-based usability tests. We gain insights for streamlined the information architecture and interaction flows to lower cognitive load and reduce driver-distraction.
Final Design
HMI Design System
HMI Design System
HMI Design System
To support a Porsche's future that’s not only more intelligent—but also more emotionally engaging and trustworthy, we needed to redefine Porsche’s in-cabin interaction.
To support a Porsche's future that’s not only more intelligent—but also more emotionally engaging and trustworthy, we needed to redefine Porsche’s in-cabin interaction.
We analyzed Porsche’s brand essence—balancing ambition and tradition, engineering and emotion—to guide a design system rooted in human touch and focused performance.
We analyzed Porsche’s brand essence—balancing ambition and tradition, engineering and emotion—to guide a design system rooted in human touch and focused performance.
The new HMI system draws from Porsche’s visual DNA—merging quiet luxury, modern precision, and racing innovation—into a consistent, intelligent interaction language.
The new HMI system draws from Porsche’s visual DNA—merging quiet luxury, modern precision, and racing innovation—into a consistent, intelligent interaction language.
Quiet Luxury & Heritage
Quiet Luxury & Heritage
Quiet Luxury & Heritage
Modern & Precision
Modern & Precision
Modern & Precision
Performance & Innovation
Performance & Innovation
Performance & Innovation
Key Screens
Key Screens
Main Screen
Situational Awareness
Porsche Classic 5 Gauge
Porsche Classic 5 Gauge
Suggest Manual Takeover
Suggest Manual Takeover
Suggest Auto Driving
Suggest Auto Driving
Takeover suggest with ambient light
Takeover suggest with ambient light
Takeover warning with ambient light
Takeover warning with ambient light
3D Car Control
3D Car Control
Car Setting
Car Setting
Normal Navigation
Normal Navigation
Passenger Screen
Passenger Screen
Mood Visualization
Mood Visualization
Emergency Mode
Emergency Mode
Health Visualization
Health Visualization