Data Dashboard (Internal BBT) – Indicator Detail

Indicators are evaluated based on the difference between the latest current metric result and its goal, weighted (revised) by the potential impact level of the indicator (High, Medium, or Low). See note at the bottom for a detailed explanation for why we use a weighting scale method.

• On Track: within 5% pts of goal
• Approaching: within 20% pts of goal
• Off Track: more than 20% pts away from goal

Impact Weights for Results & Goals:

• Low (30%)
• Medium (70%)
• High (100%)

Example:

• Indicator Impact: Low (means the Result and Goal are revised down by 30%)
• Result: 45% (revised down to 13.5%)
• Goal: 75% (revised down to 22.5%)
• Revised Result vs. Goal: 13.5% – 22.5% = 9% pts away from goal (classified as Approaching, as opposed to Off Track as the simple, non-weighting method would have produced)

A note on why the Latest Results are calculated based on a weighting scale method

Because some indicators potentially contribute more to moving the needle on our work, we have weighted each indicator to account for this. Consequentially, merely calculating the average of all of the indicator results does not adequately capture how well our collective efforts are doing against our goals.

For example, one indicator might be showing that we are knocking it out of the park in one area, yet the needle is still not moving. Or, another indicator moving slightly in a positive direction might have such an impact to drastically help our students succeed.

Given this, we have settled upon using a weighted average approach. Each indicator is revised based on its weighted impact and the average of these is what you see in the indicator (for both results and goals). As you can see from the example above, High Level Impact does not reduce the results and goals for that indicator.

The higher level reports (see Reports section on the main Data Dashboard page) roll-up this metric data to determine whether this indicator is on-track, etc. For each indicator, we are focused on a single metric at a single location for a single demographic to determine this.

Therefore, we need to designate one of these metrics as the Primary one to use for this (this is likely the target population for the initiative). The Secondary metrics might be used in other reports (metrics over time, etc.).