risk-compliance · assessments · procurement-sourcing

Bid Evaluation Matrix

Ranks competing bids by weighted score across your criteria, with a robustness check on the weights. Use it to support a procurement decision.

Last updated
Repeating-Item Builder

Calculator overview

Inputs and outputs

This summary comes from the calculator's published input and output contract.

Inputs

Evaluation Criteria Grid
About this input

One row per evaluation criterion: its name and its weight as a number from 0 to 100. The tool multiplies each bidder's score on a criterion by that criterion's weight, adds the results, and ranks the bidders on the weighted total.

Default 12 rows
ColumnRange or allowed values
Criterion Not declared
Weight 0 to 100
Bidder A 0 - Does not meet, 1 - Major shortfall, 2 - Partially meets, 3 - Meets, 4 - Exceeds, 5 - Substantially exceeds
Bidder B 0 - Does not meet, 1 - Major shortfall, 2 - Partially meets, 3 - Meets, 4 - Exceeds, 5 - Substantially exceeds
Bidder C 0 - Does not meet, 1 - Major shortfall, 2 - Partially meets, 3 - Meets, 4 - Exceeds, 5 - Substantially exceeds
Bidder Names
About this input

One row per bidder, giving the name shown against each score column. Up to three bidders are compared side by side, and each bidder is scored on every criterion. Names should be distinct: duplicate names draw a CHECK because the per-bidder counts and winner labels become unreliable.

Default 1 row
ColumnRange or allowed values
Bidder A Not declared
Bidder B Not declared
Bidder C Not declared

Outputs

Weighted Score Bidder A
About this output

Bidder A's weighted total, in percent of the maximum possible, combining every criterion score with its weight.

Unit %
Weighted Score Bidder B
About this output

Bidder B's weighted total, in percent of the maximum possible, combining every criterion score with its weight.

Unit %
Result Is Close
About this output

Whether the winner's margin over the runner-up is small enough that a minor change in scores or weights could change the outcome.

Unit yes/no
Robustness
About this output

A plain reading of how stable the winner is across the stated-weight, equal-weight and dropped-criterion checks. A robust result wins all three; a fragile one changes; when the heaviest criterion carries all the weight the check is not assessable.

Unit verdict
Winner Under Stated Weights
About this output

The bidder with the highest weighted total using the weights you entered. An exact tie at the top is reported as a tie rather than resolved in favour of the left-most bidder.

Unit bidder
Winner Without The Heaviest Criterion
About this output

Which bidder would win if the single most heavily weighted criterion were removed, showing how much that one criterion decides the outcome. Only the first criterion holding the maximum weight is removed; when it carries all the weight the check reads Not assessable rather than naming a winner.

Unit bidder
Weighted Score Bidder C
About this output

Bidder C's weighted total, in percent of the maximum possible, combining every criterion score with its weight.

Unit %
Winner Under Equal Weights
About this output

Which bidder would win if every criterion carried the same weight, a check on how much the stated weights drive the result.

Unit bidder
Rank Bidder C
About this output

Where Bidder C places among the bidders on the weighted score, with 1 the highest.

Unit rank
Criteria Led Bidder C
About this output

The number of individual criteria on which Bidder C holds the top raw score, counted before weighting.

Unit count
Heaviest Criterion
About this output

The criterion carrying the largest weight, the one with the most influence on the ranking.

Unit criterion
Criteria Led Bidder A
About this output

The number of individual criteria on which Bidder A holds the top raw score, counted before weighting.

Unit count
Criteria Led Bidder B
About this output

The number of individual criteria on which Bidder B holds the top raw score, counted before weighting.

Unit count
Rank Bidder A
About this output

Where Bidder A places among the bidders on the weighted score, with 1 the highest.

Unit rank
Rank Bidder B
About this output

Where Bidder B places among the bidders on the weighted score, with 1 the highest.

Unit rank
Margin Over The Runnerup
About this output

The gap in weighted-score points between the winner and the second-placed bidder. A small margin means the outcome is sensitive to the scores and weights.

Unit points
Model Status
About this output

The overall check on your entries, shown above the results. It reads OK when the inputs are usable, NOT VALID with a reason when an entry makes the model meaningless, or CHECK with a reason when a result is valid but worth a second look. Read it before you trust the numbers below.

No unit declared

Methodology

Purpose and model boundary

This model compares exactly three bidders across twelve fixed evaluation criteria. It calculates weighted scores, ranks and outright criterion leads, then repeats the winner calculation under equal weights and with the single heaviest criterion removed. The three views are a sensitivity check on the stated weighting, not proof that the selected bidder is suitable or that a procurement process is compliant.

The spreadsheet remains the calculation authority. The page sends the two fixed grids to the workbook and presents the returned winners, scores, chart and status without reproducing the scoring logic in browser code.

Inputs and units

Input Meaning and restriction
Bidder names Three required text labels. Names should be distinct so winner labels and per-bidder counts remain reliable.
Criterion weight, w_i Integer weight from 0 to 100 for each of the twelve criteria. The weights do not have to total 100; the model normalizes by their sum.
Bidder rating, s_ij One of six listed ratings, mapped to the integers 0 through 5, where 5 is best. Every bidder must have a listed rating on every criterion.

The criterion wording and the number of criteria are fixed by this version of the workbook. Price is not entered as currency: if price is evaluated, it must first be converted into a rating on the same 0-to-5 scale using a method chosen and documented outside this model.

Governing relationships

For criterion i and bidder j, let w_i be the criterion weight and s_ij the numeric rating. With maximum rating s_max = 5, the stated-weight score is:

Score_j = sum(w_i × s_ij) / (s_max × sum(w_i))

The equal-weight comparison is:

EqualScore_j = sum(s_ij) / (12 × s_max)

Let h be the first criterion carrying the maximum entered weight. The heaviest-criterion comparison is:

WithoutHeaviest_j = sum over i != h (w_i × s_ij) / (s_max × sum over i != h w_i)

Scores are ranked from greatest to least. Equal scores receive equal rank, and a winner output lists every tied bidder. The stated-weight margin is:

Margin = greatest Score_j - second-greatest Score_j

The result is close when 100 × Margin < 2, using the workbook's two-percentage-point threshold. A bidder leads a criterion only when it alone has the greatest rating on that row; tied criteria are counted separately.

Calculation sequence

  1. Validate all 36 rating labels, the twelve numeric weights and the three bidder names.
  2. Map each rating label to its 0-to-5 value and calculate stated-weight points and normalized scores.
  3. Rank the stated-weight scores, identify the winner or tied winners, and calculate the runner-up margin.
  4. Recalculate all three bidders with equal criterion weights.
  5. Identify the first maximum-weight criterion, remove it, and recalculate when positive weight remains.
  6. Compare the three winner strings. Robustness is consistent only when all three agree, sensitive when they differ, and not assessable when the heaviest criterion carries all positive weight.
  7. Count each bidder's outright criterion leads and evaluate Model_Status in the precedence below.

Outputs and interpretation

The three winner outputs answer three different questions: who wins under the entered weights, under equal weights, and without the first heaviest criterion. Robustness summarizes agreement among those views. It is not a confidence interval or statistical significance test. Margin_Over_The_Runnerup is expressed as the gap between normalized scores; the close-result rule reads that gap in percentage points.

The chart compares every bidder under all three weightings. Criteria_Led_* counts outright row wins, while the score and rank still reflect all weighted ratings. A bidder can therefore win the total while leading relatively few criteria.

Validation and status logic

The workbook evaluates status in this order:

Condition Returned status
Fewer than all 36 ratings match the six-item rating list NOT VALID: a rating is blank or not one of the listed options
Any weight is not numeric NOT VALID: a weight is not a number
Any weight is blank NOT VALID: a weight is blank
Any weight is negative NOT VALID: a weight is negative
Any weight exceeds 100 NOT VALID: a weight exceeds 100
Total weight is zero NOT VALID: total weight is zero
Fewer than three bidder names are filled in NOT VALID: bidder names must be filled in
Bidder names are not unique CHECK: bidder names are not unique, so the per-bidder counts and winner labels are unreliable
The stated-weight margin is below two percentage points CHECK: the result is close; the margin over the runner-up is within the threshold
Removing the heaviest criterion leaves no positive weight CHECK: the robustness check is not assessable; the heaviest criterion carries all the weight
The winner differs among the three weighting views CHECK: the winner changes under a different weighting, so the decision rests on the weights
None of the preceding conditions applies OK

Earlier conditions take precedence. For example, an exact tie returns the close-result CHECK before the workbook considers weighting sensitivity.

Assumptions and limitations

  • Ratings are subjective judgements on a coarse ordinal scale. The model treats the distance between adjacent labels as equal and does not reconcile multiple evaluators.
  • The twelve criteria, three-bidder capacity, rating scale and two-point close threshold are fixed on the published page. They may not match a particular procurement policy.
  • If several criteria share the greatest weight, the removal test excludes only the first such row, because the workbook uses the first maximum match.
  • Equal weighting and one-criterion removal are limited sensitivity tests. They do not test every plausible weighting, rating error, scenario or dependency among criteria.
  • The model has no pass/fail gateway, minimum technical score, price formula, abnormally-low-bid test, conflict-of-interest workflow, moderation record, qualitative evidence store or multi-stage evaluation.
  • Weights should be approved and fixed before bid scores are known. The workbook cannot detect whether weights were changed after bids were opened.
  • Regulated procurement rules vary. Some regimes restrict numeric weighting or require disclosed factors and procedures that this calculator does not implement.

Restrictions and non-computing states

Both inputs are fixed-size grids: twelve criteria by three rating columns plus weight, and one row of three bidder names. The page refuses an incorrect grid shape, an unlisted rating, a blank required cell, or a weight outside the declared integer range before the calculation runs. The workbook independently returns the exact NOT VALID messages above for the download path. A zero total weight makes every normalized score undefined. When one criterion carries all positive weight, the stated and equal views remain computable but the without-heaviest view is explicitly not assessable.

Errors and warnings

A rejected entry means the submitted grid did not meet the published input rules and no workbook decision was made. Workbook NOT VALID means a score cannot be trusted. Workbook CHECK retains a computed comparison but flags ambiguous names, a close outcome, an unavailable sensitivity view or a winner that depends on weighting. A connection or calculation-service failure is an availability problem, not a procurement finding.

References

The workbook implements a general normalized weighted-scoring method and states that it reproduces no procurement framework or official evaluation scheme. Its release audit also identifies the jurisdiction-specific limits illustrated by FAR 15.304 and AFARS 5115.304. Those sources do not define this workbook's criteria, weights or ratings and must not be read as endorsing the model.

This page is provided by LogicCommons for informational purposes only. Results are analysis outputs computed from the inputs you supply and are not engineering advice, a design, or a substitute for review by a licensed professional under the codes adopted where the work is built. Verify all inputs and results independently.

LogicCommons is in beta. If a result, label, or reference looks wrong, tell us here; we read every message.