While implementing your project, it must be evaluated regularly to see if it is meeting its purpose and delivering useful data. The goal is to adjust your project based on the evaluation’s findings. This chapter will help you plan your evaluation – when it will take place, who will carry it out, what questions you will ask, and how you will record the answers to those questions.
When is the evaluation?
Scheduling periodic reviews of your citizen science project improves the likelihood that the evaluations will be conducted when needed. Evaluations are typically done after the project’s first year or season. All aspects of the project don’t necessarily need to be reviewed at the same time, at the same intervals, or by the same individuals.
Who will perform the evaluation?
Determine who will be the individuals responsible for carrying out the evaluation.
- Independent Reviewers – Reviewers without a vested interest in the project can assist the review process by providing an outside perspective and by addressing issues that participants may find controversial or hard to discuss honestly. Scientists or government researchers can recommend independent reviewers.
- Project Team – Forest Service personnel and partners can also be evaluators. If any or all partners were not involved in developing the project, their involvement in the evaluation process would enable them to become more familiar with the project and gain a new or expanded interest in the project’s success.
- Volunteers – It would be highly beneficial during the implementation step to have a feedback mechanism from the volunteer group.
What are the questions?
Identify the questions you must answer. Some of these questions should be asked of volunteers – it is important to know their opinions on what worked and what didn’t. Answers to these questions can be either quantitative (for instance, numerically scored questionnaires) or qualitative (such as group discussions).
Some evaluation questions can be found in the USFS General Technical Report Broadening Participation in Biological Monitoring: Handbook for Scientists and Managers. Take a look at these questions below and see which are applicable to your citizen science project.
How will the answers be recorded?
Determine how you will record, summarize, and document the evaluation. That way, the results can be more easily incorporated into project revisions.