Crisis Sim Managers can access per-exercise results and After Action Reports, export data to CSV, and find organization-wide Crisis Simulations data in the Reports section.
Platform role required: Crisis Sim Manager
Finding your results
Finding your results after an exercise is easy.
- Navigate to Exercise > Crisis Simulations
- Select All exercises
- Select the ended exercise for which you want to view the results (Note: you can use the filter to filter by Ended)
- Select View after action report
You'll see two options:
- View Results — displays results for all participants, including decision-point details and a CSV export option.
- View After Action Report (AAR) — complements View Results with actionable insights and performance metrics to help you determine next steps.
View Results
What you see in View Results depends on how the exercise was run.
For presentation exercises (facilitated):
- The overview page shows the average score and participant count.
- Select individual injects to see inject-level results and which answers were most popular.
- The host is the only person submitting the final response on behalf of participants, so the tabs show the host's final votes — one vote per inject.
For asynchronous exercises (Single Player and Drill):
- The overview page shows the scenario's average score, the number of users assigned, and the number who've completed it.
- You can view individual results for each participant — overall scores, individual feedback for every option selected, and participants' confidence and justification for their chosen response.
Results for exercises with a deadline are only available once the deadline has passed, or once completed by the individual. Results for exercises without a deadline are only available once all users have completed them. |
Exporting results to CSV
The Overview page in View Results includes an Export CSV button on the right.
The CSV export includes:
- Exercise score
- Number of participants
- Total exercise time
- Role categories
- Briefing (exercise background/summary)
- Participant list
- Completion status
- Injects (title, details, and response options)
- Detailed responses per inject
- Detailed responses per participant
After Action Report
The After Action Report (AAR) maps team performance directly to the Crisis Exercise Framework. It uses real-time data, team alignment metrics, and a refined scoring methodology to give you actionable, data-driven insights into crisis readiness and training priorities.
How the AAR updates
The report updates as participants respond. Once you close the exercise, allow a couple of minutes for the complete dataset to finalize — a banner confirms when all results are in.
Report header
The information metric bar at the top of the report displays core session metadata:
- Participants / Assignees — total users who submitted a vote or decision in the selected mode.
- Exercised Injects — the number of injects that received at least one active user decision.
- Phases Exercised — how many of the eight Crisis Exercise Framework phases were actively tested, shown as X/8.
- Duration and Date — the exact execution date and runtime of the simulation.
- PDF Export — download and share the full report with executive stakeholders.
A collapsible Scenario Briefing Dropdown at the top of the report lets you review the initial scenario context, threat vectors, and objectives at any point during the debrief.
For exercises completed before the current release, an on-screen blue banner links to the legacy format report.
The legacy view will be retired in January 2027. Export any required historical data to PDF before that date.
Framework-aligned performance
Each inject is tagged to one of the eight Crisis Exercise Framework phases. The AAR rolls up scores to show performance against each phase, so you can see exactly which phases your team handles well and which are blind spots.
Confidence-adjusted scoring
Scoring is consistent across all playthrough modes and appears at phase, inject, and participant level. When confidence tracking is enabled, scores are further adjusted to account for real-world risk: a confident correct answer gets full points, a confident incorrect answer is penalized more heavily than an uncertain one (since confident errors are riskier in real scenarios). This weighting carries through all rollups where confidence is enabled.
Team alignment
The Participant Alignment metric shows whether your team is trained and aligned on the same approach:
- Unified — at least 60% of responses in agreement. Indicates a strong shared understanding.
- Split — two dominant views each with at least 30% of total responses across at least 80% of respondents. The team is divided but coherent; consider clarifying procedures.
- Fragmented — neither Unified nor Split. Signals procedural gaps or insufficient training.
Performance scores
The two headline scores can be read together:
- Participant Score — measures overall team capability, adjusted for confidence. Calculated at individual response level, then rolled up by inject and across the exercise.
- Presenter Selection Score — shows whether your final decision-maker made sound choices. This score only appears in presentation mode.
If both scores are high (at least 66.6%), your team has sharp instincts and strong collaboration. If Participant Score is high but Presenter Score is low, your team is capable but consensus is breaking down. If Participant Score is low (33.3% or below), you're looking at foundational gaps that need training.
Supporting metrics
- Participant Accuracy — measures the raw quality of votes against best practice on a standardized scale: Great (100 points), Good (75 points), Okay (50 points), and Weak (25 points). Averaged across the exercise and reported as High (>66.6%), Medium (>33.3% to ≤66.6%), or Low (≤33.3%).
- Participant Confidence — maps confidence selections to weights: Very confident (100), Confident (75), Somewhat confident (50), Not very confident (25), Not at all confident (0).
- Participant Alignment — macro alignment is Unified if more than 50% of injects are categorized as unified, and Non-Unified otherwise. Alignment appears in presentation and single player mode only — it's not applicable in drill mode.
- Participation / Completion — in presentation mode, measures the average percentage of votes cast per participant; in single player mode, shows the percentage and distribution of assigned users who completed, partially completed, or haven't started; in team drill mode, this metric is hidden.
Crisis Framework Heatmap
The heatmap rolls up performance from answered injects tagged to each crisis phase. Green shows strength, amber indicates areas needing work, red flags critical gaps, and grey reveals phases not exercised — potential blind spots. What the heatmap measures depends on which settings were enabled during scenario creation: risk-adjusted accuracy (if both ranking and confidence are on), mean question accuracy (ranking only), mean user conviction (confidence only), or unified vs. non-unified consensus (if both are off).
Performance Highlights
Surfaces immediate wins and vulnerabilities without manual filtering:
- Areas of Strength — up to three top-performing injects with a combined accuracy and confidence score above 66.7%.
- Areas for Improvement — up to three high-risk injects with combined scores at or below 33.3%.
Performance by Inject Scatter Plot
Injects are plotted by Accuracy (x-axis) and Confidence (y-axis). Injects in the top-left quadrant — high confidence, low accuracy — are your highest-risk failure zones where teams are confidently making wrong decisions. Bottom-right — high accuracy, low confidence — reveals teams who need reinforcement to trust their judgment.
Performance by Participant Scatter Plot
Plots individual users on an interactive graph by Accuracy (x-axis) and Confidence (y-axis), making it easy to identify low-scoring outliers or overconfident individuals who need targeted coaching.
Inject Breakdown Matrix
A complete tabular view of all exercised injects. Each row shows the tagged Crisis Exercise Framework phase(s), combined Participant Score (High, Medium, or Low), raw Participant Accuracy percentage, raw Participant Confidence percentage, Inject Alignment status (Unified, Split, or Fragmented), and Presenter Selection classification (Great, Good, Okay, or Weak).
Participant Breakdown Matrix
User-level detail that adapts to the playthrough mode:
- Presentation mode — surfaces active participants, their participation rates, and specific voting actions. Users who log in but don't vote are excluded.
- Single Player mode — shows assignees, individual scoring metrics, and completion states (Completed, In Progress, Not Started). Deleted or unconfigured accounts show as Anonymous Account.
- Team Drill mode — shows participant identities, core performance scores, and corporate roles assigned during the simulation.
What the settings affect
To get the full diagnostic value from the AAR, option ranking and response confidence are enabled by default. Turning them off limits what the report can show:
- With Option Ranking off — overall scores, Presenter Selection Score, and Participant Accuracy show empty states; the Performance Highlights panel is hidden; the heatmap falls back to Confidence or Alignment.
- With Response Confidence off — scores bypass confidence-risk weighting; confidence metrics and participant scatter plots show empty states; the heatmap defaults to Accuracy only.
- With Phase Tagging off — injects don't map to the framework lifecycle; all heatmap categories default to "Not Exercised".
- With both Option Ranking and Response Confidence off — all numerical scoring, accuracy, confidence tracking, and scatter plots show empty states; the Performance Highlights panel is hidden; the heatmap falls back to Participant Alignment only.
Scenario Performance Trends
A chronological graph showing how performance and KPI metrics trended throughout the exercise. Available in Presentation and Team Drill modes only.
Platform reporting data
You can find broader Crisis Simulations reporting data in the Reports section of the platform — from high-level overviews to team engagement comparisons and inject-level detail in the Data Explorer.
Some reports require the Organization Manager platform role. If you only have the Crisis Sim Manager role, you won't have access to those dashboards.
Navigate to Reports in the main navigation menu. Relevant data points for Crisis Simulations are spread across several dashboards:
- Overview Dashboard — last Crisis Sim exercise date per user; exercises completed in the last 12 months.
- Platform Usage Dashboard — percentage split of user activity by content type; Crisis Sim participant count across all exercises in the selected date range.
- Team Comparison Dashboard — percentage of assigned Crisis Sim exercises completed.
- Crisis Responders Dashboard — exercise activity breakdown; low-capability themes and low-score injects; low-risk and higher-risk teams; capability by user and by inject (score vs. confidence scatter).
- Data Explorer — export detailed crisis sim exercise data with flexible filters.
Useful Data Explorer filter combinations:
- For an asynchronous exercise — column picker: email, inject name, option title; filter by exercise name.
- For a presentation exercise — column picker: participant ID, inject name, option title; filter by exercise name; in the "Currently licensed" section, select both "yes" and "no" to include all presentation mode participants.