AI Skill Report Card

Evaluating Decisions

A89·Sep 27, 2026·Source: Web
14 / 15

Given a decision with multiple options, produce:

  1. Decision Matrix — options scored against weighted criteria
  2. Tradeoff Analysis — what you gain/lose with each option
  3. Recommendation — the pick, with justification and confidence level

Example prompt: "Should we use PostgreSQL, MongoDB, or DynamoDB for our new order-tracking service?"

Recommendation▾
Add a brief edge case for when criteria weights are highly contested among stakeholders (conflicting priorities)
14 / 15

Progress:

  • Step 1: Clarify the decision — what's actually being decided, and by when
  • Step 2: Identify all viable options (don't skip the "do nothing" option if relevant)
  • Step 3: Define evaluation criteria and their weights
  • Step 4: Score each option against each criterion
  • Step 5: Build the Decision Matrix
  • Step 6: Write the Tradeoff Analysis
  • Step 7: Give a clear Recommendation with confidence and conditions

Step 1 — Clarify the decision State the decision in one sentence. Note constraints (budget, time, must-haves) and who's affected.

Step 2 — Identify options List 2-5 realistic options. Merge near-duplicates. Always consider "status quo / do nothing" as a baseline unless explicitly irrelevant.

Step 3 — Define criteria Pick 4-6 criteria that actually differentiate the options (e.g., cost, speed to implement, risk, scalability, reversibility). Assign weights (e.g., 1-5 or percentages) reflecting what matters most to the stated goal. Ask what's implicit if the user didn't specify priorities — otherwise default to a sensible weighting and state your assumption explicitly.

Step 4 — Score Score each option per criterion on a consistent scale (e.g., 1-5). Base scores on evidence or stated facts, not vibes — note assumptions when data is thin.

Step 5 — Decision Matrix Present as a table: rows = options, columns = criteria (with weights), plus a weighted total column. Sort by total score descending.

Step 6 — Tradeoff Analysis For each option, 2-4 bullets covering: what you gain, what you sacrifice, key risk, and reversibility (how hard to undo).

Step 7 — Recommendation One clear pick (or a conditional "if X, choose A; if Y, choose B"). State confidence (high/medium/low) and the top 1-2 conditions that would change the recommendation.

Recommendation▾
Include an example with a close/tied score scenario to demonstrate the 'toss-up' pitfall guidance in action
18 / 20

Example 1: Input: "Choose a database for order-tracking service. Priorities: reliability, dev speed, cost."

Output:

Decision Matrix

OptionReliability (x3)Dev Speed (x2)Cost (x1)Weighted Total
PostgreSQL5 (15)3 (6)4 (4)25
MongoDB3 (9)5 (10)4 (4)23
DynamoDB4 (12)3 (6)2 (2)20

Tradeoff Analysis

  • PostgreSQL: Strong consistency and mature tooling; slower initial schema iteration; easy to reverse (widely supported).
  • MongoDB: Fastest to prototype with flexible schema; weaker transactional guarantees for order integrity; moderate reversibility.
  • DynamoDB: Scales effortlessly, low ops burden; highest cost at scale and steep query-modeling learning curve; hard to reverse once data model is baked in.

Recommendation Choose PostgreSQL (high confidence) — order-tracking needs strong consistency, and the dev-speed gap is small enough to accept. Reconsider MongoDB only if the team has zero SQL experience and timeline is under 2 weeks.

Example 2: Input: "Should we hire a contractor or a full-time employee for a 6-month project with likely follow-on work?"

Output:

Decision Matrix

OptionCost (x2)Speed to Onboard (x2)Long-term Fit (x3)Flexibility (x1)Weighted Total
Contractor4 (8)5 (10)2 (6)5 (5)29
Full-time Hire2 (4)2 (4)5 (15)2 (2)25

Tradeoff Analysis

  • Contractor: Fast start, lower short-term cost, easy to end engagement; weaker institutional knowledge retention if follow-on work materializes; highly reversible.
  • Full-time Hire: Better long-term investment if follow-on work is likely; slower hiring process and higher fixed cost; low reversibility (layoffs are costly/disruptive).

Recommendation Choose Contractor now (medium confidence), with an explicit option-to-convert clause. If follow-on work is confirmed within 3 months, revisit and convert to full-time — this captures speed now without sacrificing long-term fit.

Recommendation▾
Consider a minimal template snippet (blank matrix structure) separate from full examples for faster reuse
  • Always state assumed weights/priorities explicitly if not given by the user.
  • Keep the matrix to 3-5 options and 4-6 criteria — more becomes noise.
  • Distinguish facts from assumptions in scoring; flag low-confidence scores.
  • Always address reversibility — irreversible decisions deserve more scrutiny and higher evidence bar.
  • Prefer conditional recommendations ("if X, then A") over false precision when the top two options are close.
  • Surface the "do nothing" option when it's a legitimate alternative.
  • Don't pick criteria that don't actually differentiate the options — wastes matrix space.
  • Don't average scores without weights — unweighted totals hide what actually matters.
  • Don't present a recommendation without confidence level and disconfirming conditions.
  • Don't hide the reasoning behind a single "best" score — the tradeoff analysis is the real value, not just the ranking.
  • Don't treat close scores (within ~10%) as decisive — call out when it's a toss-up and hinge the recommendation on a specific tiebreaker.
0
Grade AAI Skill Framework
Scorecard
Criteria Breakdown
Quick Start
14/15
Workflow
14/15
Examples
18/20
Completeness
18/20
Format
15/15
Conciseness
13/15