You are here

Analysis of results in the Multi-criteria Results chart

A Multi-criteria results chart is created automatically when a Rating on one criterion is extended to become a Multi-criteria analysis. Like all charts, a Multi-criteria chart visualizes the data of the corresponding results table which is, in this case, the Multi-criteria results table.

Fundamentals

Charts on multiple criteria display data points or 'bubbles' in a coordinate system. By default, the first rating of the Analysis is displayed on the X-axis, the second on the Y-axis and the third determines bubble size. You can change this mapping in the 'basic' settings tab.

If your analysis involves more than three ratings or you have added calculated columns to the underlying results table, you may want to analyze that data by multiple charts. For this, mark up the table in the Agenda and add as many Multi-criteria charts as required from the toolbar's 'Plus' menu.  

If there are many items in your Multi-criteria analysis, the diagram may get crowded with data points overlapping which is why the chart defaults to only 15 items per chart. The sort criterion of the chart determines which items come first. Adjust the sort criterion in the 'basic' settings tab. Set the number of items in the 'View control' widget that sits above the chart.

Note that you can delegate 'View control' to participants in the 'View' settings tab.

Analysis

For a joint, facilitated analysis, it is easiest to share your screen and walk participants through the chart.

Alternatively, open the chart for participants for them to browse independently. In this case, use 'Focus' to draw attention to specific items. 'Focus' will also communicate your settings regarding Team comparison etc which means that you can use it to provide (force) a shared view of the chart when needed.

  • Select one or several items in the item list to highlight the corresponding data point and vice versa.
  • Click 'outside' or press 'Esc' to reset selection (deselect all)”.
  • If rating has occurred "by team", view results for each team or compare teams via the 'Team comparison' widget in the bottom status bar.
  • If items have been categorized in folders, you can view results by folder
  • Mouse-over individual data points (bars, pieces of pie) to display that item's mean rating and (normalized) Standard Deviation (SD).

 

Accessibility of the chart

Since you and your group may want to analyze some results of your Multi-criteria analysis while some ratings are still in progress, Multi-criteria charts are not blocked by a progress meter. The axis of criteria whose single results table or chart would be barred by a 'progress meter' will simply show a label, 'in progress'.

To include the Results for that criterion, simply 'close' the corresponding Rating sheet.

Note that if you have good cause to enable access to the results while rating is in progress, you can do so by selecting the relevant option in the 'View' settings tab of the Rating sheet.

Decision making

If you are trying to reach a decision in the group, Multi-criteria charts will often provide an easily accessible basis for that decision, especially, if you have run your analysis after a Discussion on the relevant criteria.

However, the chart will not make the decision for you. Use it as a basis for focusing the conversation on the relevant items and reaching a conclusion by such a conversation.

That said, results charts can be almost too suggestive: If there is that one fat data point(s) in the top right corner, surely that must be the decision! Well, maybe. However, if your group has merely been asked to inform the decision of management rather than make a decision, you may not want to foster possibly false assumptions about what that decision will be.

In short, as charts can be quite suggestive as to 'obvious conclusions', refrain from graphic analysis when it is not up to the group to draw such conclusions. In such cases, you may want to present your participants with a quick glance at the Multi-criteria results table instead and say something like: "Thank you for this wealth of data. It should give management all the information they require to make their decision."