In this 5-minute video, Natalia Kucirkova, Chair of our Academic Advisory Board and Kwame Nyatuame, Chair of our Non-academic Advisory Board, explain how the rubrics behind EduEvidence certifications were built and how the system works.
If you prefer to read, you’ll find this video’s contents as an article below.
In short: What is EduEvidence?
EduEvidence is a not-for-profit organization based in Norway, committed to providing evidence-based certifications for EdTech (Educational Technology) products globally.
Based on five comprehensive research reports from the University of Stavanger (which are open-access), we provide certifications in five areas of impact (the “5Es” Framework): EFFICACY, EFFECTIVENESS, EQUITY, ETHICS, and ENVIRONMENT.
Our process if fully transparent, and the criteria are tailored with adjusments made to ensure fairness for both start-ups and more mature companies.
In general, our certifications are awarded in three levels: Bronze, Silver, and Gold.
And as in the Olympic Games, each level is worth celebrating!
What is the difference between the “5Es”?
The “5Es” are an aspirational framework that represents a blueprint for the quality standards that the EdTech industry should target to achieve and maintain.
The Framework combines evaluation indexes, frameworks, benchmarks, awards and other criteria that signal a demand for quality in the industry. The first three awardees for the EFFECTIVENESS and EFFICACY categories were Kahoot!, Age of Learning and GraphoGame. All certified products are listed in our global list.
The first two “Es”, EFFICACY and EFECTIVENESS, are the areas of impact related to educational outcomes. These are the learning benefits of your EdTech tool or resource on its intended users, who can be students, teachers, parents, and other communities.
- EFFICACY is focused on controlled studies conducted by researchers, each corresponding to a specific award level: Scientific reviews (Bronze), Correlational studies (Silver), and Randomized Controlled Trials or RCT studies (Gold).
- EFFECTIVENESS focuses on studies conducted by (or in close collaboration with) teachers in their classrooms, in a participatory way: Pedagogical reviews (Bronze), Cost-effectiveness studies (Silver), and Replication studies (Gold).
When it comes to ETHICS, EQUITY, and ENVIRONMENT, these are broader categories with a great importance when considering the holistic impact of an EdTech product.
- ETHICS refers to demonstrating that a solution processes data responsibly and that its design upholds ethical standards. Its key questions is: Does the EdTech’s approach to engaging with data, users, and communities withing the ecosystem adhere to ethical standards?
- EQUITY is dedicated to access for those who are frequently underserved. Its key question is: How much does the EdTech solution focus on marginalized communities, promote equal rights and social justice?
- ENVIRONMENT addresses the ecological footprint of an EdTech solution, including its potential positive or negative impact on sustainability. Its key question is: To what extent does the EdTech organization evidence its care for the local and wider environment?
How can you obtain one of these certifications?
There are two routes for obtaining a certification from EduEvidence:
1) You can submit an evidence report directly for us to review.
For example, if a correlational study of your EdTech solution has been conducted and you submit it, we would consider your eligibility for the Silver EFFICACY Certification.
2) You can present an existing, equivalent certification from an established provider for recertification.
For example, if your product has already demonstrated positive results in a study algined with ESSA (“Every Student Succeeds Act”) in the United States which resulted in a certification, EduEvidence can recertify it under our EFFICACY Certification.
What enables EduEvidence to provide recertification?
We are able to provide this benefit after developing an internationally consolidated benchmark that was created through a consortium of researchers, as well as multiple rounds of stakeholder consultations and systematic research reviews.
This benchmark allows equivalence between recognized certifications schemes. The list of certifications recognized within our equivalence scheme is available here.
What is the validation mechanism?
Our two-stage validation mechanism is both simple and rigorous:
1) First, your company fills out a form submitting your research report or other supporting evidence.
2) Then, your submission is reviewed by an independent validator who is not involved in the original study. This validator applies EduEvidence’s consolidated benchmarks and either provides a recommendation for certification, or suggests conducting further research.
You can read more about our full Certification Process and its benefits by clicking here.
What does a certification include?
Based on the validator’s recommendation, EduEvidence issues the final certification to each successful applicant, which includes:
- An official certificate specifying the evidence that qualifies the product for the award.
- A badge of recognition to use in your product’s website and promotional materials.
- Gaining entry into our global list of independently certified EdTech products.
The more independent evidence of positive impact your product demonstrates, the higher its position on the list!
Does my product qualify for certification?
If you’re unsure if your EdTech product qualifies for one of our certifications, you can try one of the free self-assessment tools for each of the five areas of impact.
This is a great way to understand your current evidence base and identify the next steps toward achieving higher impact.
Certifications are a great way to show the world that you care about the quality of your product and the holistic impact it has on students, teachers, parents, and other communities.
We hope you will join this movement for advancing evidence-based EdTech, for the benefit of them all!
Evaluation criteria
To consult our exact evaluation criteria, you can read the following documents.
For the EQUITY and ENVIRONMENT strands, we may also review and accept documentation where you describe how you would align with our criteria.
The EduEvidence certification badges
Each badge is valid for two years from the date of its issue, after which reevaluation is required.
Badges may also be displayed on selected EdTech platforms from our partners, including on the ISTE EdTech Index.
We understand that EdTech products evolve over time, with new versions introducing changes and improvements. To maintain relevance, certifications must specify the exact version of the product that has been evaluated.
Drawing on best practices from Education Alliance Finland, we have developed a detailed checklist to ensure consistent evaluation across product versions. This is why our Certification Process incorporates tailored version checks depending on the area of impact that is being assessed. For instance, the implications of updates for ETHICS differ from those for EFFICACY.
For guidance on versioning and updates to your certified product, please don’t hesitate to contact us.
Our Certification Process
A Company can apply for a certification with existing certification or with research done internally or with a Research Partners: research organizations that support companies with studies relevant to one of the “5Es” areas of impact.
You can read more about our Certification Process by clicking here.