Skip to Main Content

Using Microsoft Copilot for study and research

Evaluate outputs

GenAI has limitations e.g. out of date information, inaccuracies, biases. This is why you should critically evaluate its outputs. 

Below is a prompt that was generated in Copilot on 25 June 2024: 

How can we check this information is correct? 

We now want to double check this output for accuracy. We will search Google for UOW organisational chart. When checking the Google results, it points to the UOW website, which is the primary source for finding information about the UOW organisation. Primary Sources are immediate, first-hand accounts of a topic, from people who have a direct connection with it. 

When we evaluated the output from Copilot against the UOW website, it named two different people as the Vice Chancellor at UOW. The output from Copilot is out of date and inaccurate. The Google search was done on the same date and leads us to the up to date and accurate information. 

This example shows why it is important to never use GenAI as a primary source. You should always use your own thinking to evaluate outputs and crosscheck with other sources of information.

If you are unsure how to cross check information please contact the Library.