Network for Information and Digital Access

Toolkit for Science Literacy Impact Evaluation

The results of Key Task 1 Desk Research have now been synthesised and the preparation of an open online toolkit for impact evaluation across different delivery methods of science literacies is in the process of being compiled.

Items of potential interest will be added to this page as they become known to us. We encourage your participation in the process of making the toolkit as comprehensive and current as possible.

If you have content which you would like to be considered for the toolkit please contact Carol Usher

Mechanism Group/Mechanism Author(s) Year Toolkit Type of Resource
1. Events, meetings, performances
1. Exhibitions Tucker, Bricker, and Huerta 2017 An Approach to Measuring Impact and Effectiveness of Educational Science Exhibits Evaluation tool
Barriault and Pearson 2010 Assessing Exhibits for Learning in Science Centers: A Practical Tool Assessment tool
Association of Children's Museums 2010 Healthy Kids, Healthy Museums Best practices
Ecsite-uk 2008 The Impact of Science & Discovery Centres: A Review of Worldwide Studies (SEE APPENDIX - pages 12-15) (Direct download) Follow-up material (on learning outcomes
2. Expo Not yet investigated
3. Festivals Fogg-Rogers 2017 UK Science Festival Network Pilot Evaluation 2017 SEE APPENDIX - page 20 Evaluation resources
Grand and Sardo 2016 What Works in the Field? Evaluating informal science events Evaluation tools
Sardo 2016 Evaluation of the Bristol Bright Night 2015 (BBN15)SEE APPENDIX - pages 25-34 Questionnaires Fieldwork materials
Science Festival Alliance 2014- Science Festival Alliance Evaluation tools
UK Research and Innovation's (UKRI) 2011- Evaluation: Practical Guidelines. A guide for evaluating public engagement activities Guidelines
National Co-ordinating Centre for Public Engagement Various years Evaluating public engagementAlso Evaluation resources
Audience London 2011 Researching audiences at outdoor events and festivals ToolkitGuidelines
Ecsite 2011 PLACES Impact Assessment Toolkit Toolkit
Involve - Andersson, Fennell, and Shahrokh 2011 Making the case for public engagement: How to demonstrate the value of consumer impact Toolkit
Informal Science 2010 Informal Science. Evaluation & Evaluation Toolkitsand GuidelinesEvaluation toolsFollow-up materials
NSF EvaluATE 2010 The 2010 User-Friendly Handbook for Project Evaluation Handbook
National Evaluation of Children's Fund (necf) 2005 The Evaluators Cookbook: Participatory Evaluation Exercises. A Resource for work with Children and Young People HandbookEvaluation tool
Arts Council England Arts Council England: The Generic Learning Outcomes Follow-up material
Wellcome Trust Wellcome Trust. Engaging with Impact: How do we know if we have made a difference? Guide
4. Movies Not yet investigated
5. Picnics Not yet investigated
6. Science Fairs Jet Propulsion Laboratory (NASA) How to Do a Science Fair Project Video guide
Science World British Columbia Science Fair Guide Guide
7. Seminars Spruijt et al. 2015 Factors Influencing Seminar Learning and Academic Achievement (SEE APPENDIX - Pages 10-11) Questionnaire
8. Talks Not yet investigated
9. TED Talks Not yet investigated
10. Theatre Not yet investigated
11. Workshops Stamp and Pagano 2002 Evaluation of a Workshop Series in University Science Education Also see Workshop Evaluaton
2. Education and training - including online
12. Colloquia Not yet investigated
13. Courses Not yet investigated
14. Curricula Wolf, Evers, and Hill 2006 Handbook for curriculum assessment Handbook
15. E-learning Ruggeri, Farrington, and Brayne 2013 A Global Model for Effective Use and Evaluation of e-Learning in Health Evaluation model
Vaughan, Cleveland-Innes, and Garrison 2013 E-Learning in the 21st century: A framework for research and practice, Second editionSee chapter 5 Guide
NHS Health Scotland 2008 Health Impact Assessment in Practice e-Learning Course Workbook Workbook
Mateo et al 2006 Guide to the self-evaluation of e-learning degree programmes Guide to institutional evaluation Guide
Karran 2004 On-Line Assessment for E-Learning: Options and Opportunities Assessment modes
Olds 2002 Effective Strategies to Assess the Impact of e-Learning Assessment matrix
16. Webinars Not yet investigated
3. Traditional publishing and journalism - print and broadcast
17. Animations Not yet investigated
18. Books Not yet investigated
19. Brochures Haute Autorité de santé 2008 How to produce an information brochure for patients and users of the healthcare system Guide
20. Cartoons Joyce 2016 Using concept cartoons for assessment Guide
21. Comics Tribull 2017 Sequential Science: A Guide to Communication Through Comics Guide
22. Games Morrsund 2007 Introduction to Using Games in Education: A Guide for Teachers and Parents Guide
23. Graphics Not yet investigated/td>
24. Posters Menke 2014 Implementation of Online Poster Sessions in Online and Face-to-Face Classrooms as a Unique Assessment Tool Assessment tool
O’Neill and Jennings 2012 The use of posters for assessment: A guide for staff Guide
Hess, Tosney, and Liegel 2009 Creating effective poster presentations: AMEE Guide no. 40 Guide
Summers 2005 Student assessment using poster presentations Guide
25. Publications Not yet investigated
26. Radio Skuse et al. 2004 Radio Broadcasting for Health: A decision Maker's guide Guide
27. Reports Not yet investigated
28. Television Not yet investigated
29. Videos Not yet investigated
4. Activities and services
30. Competitions Not yet investigated
31. Experiments Not yet investigated
32. Makerspaces Branigan-Pipe 2017 Making a Makerspace: The Tools, The Spaces and the Theories A Holistic Approach Design Project Guide
Crichton and Wachira 2017 Taking Making Into Classrooms in Challenging Contexts: A Toolkit Fostering Curiosity, Imagination and Active Learning Toolkit
Innovative Learning Centre 2017 Taking Making into the classroom - A toolkit for fostering curiosity and imagination Toolkit
Parks 2016 Learning in Middle School Library Makerspaces: A Makerspace Collaboration Guide for School Librarians Guide
Lawson and Atcheson 2015 Hands-On Science and Technology. An Inquiry Approach Guide
YALSA STEM Resources Task Force 2012-13 STEAM Programming Toolkit Toolkit
33. Mobile Classrooms Not yet investigated
34. Mobile Laboratories Not yet investigated
5. Online interactions
35. Blogs Not yet investigated
36. e-Books Not yet investigated
37. e-Zines Not yet investigated
38. Mobile apps Skiba 2017 Evaluation Tools to Appraise Social Media and Mobile Applications Evaluation tools
Stoyanov et al. 2015 Mobile App Rating Scale: A New Tool for Assessing the Quality of Health Mobile Apps Assessment tool
39. Podcasts Williams 2015 How could an effective podcast about alcohol use be designed and evaluated? A review of the literatureSEE APPENDIX: ‘Quick guide to designing and evaluating an effective Podcast about alcohol use’ - pages 63-64 Guide
Austria 2007 Developing Evaluation Criteria for PodcastsSEE APPENDIX 1 ‘Developing Evaluation Criteria forScience Podcasts’ - pages 194-199 Evaluation critera
40. Social Media Not yet investigated
41. Websites Welborn and Kanar 2000 Building Websites for Science Literacy Guide
42. Wikis Palomo-Duarte et al. 2014 AssessMediaWiki (AMW) WikEval Assessment tools
Sanden and Darragh 2011 Wiki Use in the 21st-Century Literacy Classroom: A Framework for Evaluation Evaluation framewrok
6. Multiliteracies/Multimodalities
43. Multiliteracy Not yet investigated
44. Multimodality Not yet investigated
7. Citizen science
45. Citizen Science The Cornell Lab of Ornithology 2010 Citizen Science Toolkit Toolkit Federal Crowdsourcing and Citizen Science Toolkit Toolkit
California Academy of Sciences Citizen Science Toolkit Toolkit
NSW Government, Office of Environment & Heritage Citizen Science Toolkit Toolkit

Back to Impact Assessment