A demonstrator for large scale accessibility benchmarking
Access for all to the Information Society is a key goal for the European Union. With increasing use of the World Wide Web – in particular for government information and services, it is essential to secure access for all citizens. Yet many people - especially those with a disability – meet barriers.
Benchmarking can locate potential barriers and fuel the development towards Internet access for all.
The European Internet Accessibility Observatory (EIAO) project has established a large scale accessibility benchmarking service. The distributed system consisting of 9 servers can process 100 web sites per day according to 26 of the automatable tests specified in Unified Web Evaluation Methodology (UWEM 1.2).
Preliminary European Accessibility Benchmarking Scores
Benchmarking scores by country have been determined according to UWEM 1.2. The results from the first evaluation, carried out in February, March and April 2008 are shown in the following table.
See also a
graphical display of the country scores
.
| Ranking | Country | Number of evaluated web sites | Score (Percentage of fail tests) | Score Description |
|---|---|---|---|---|
| 1 | United Kingdom | 8 | 17% | Some Accessibility Tests Failed |
| 2 | Sweden | 165 | 20% | Some Accessibility Tests Failed |
| 3 | Czech Republic | 46 | 21% | Some Accessibility Tests Failed |
| 4 | Netherlands | 131 | 22% | Some Accessibility Tests Failed |
| 5 | Denmark | 148 | 23% | Some Accessibility Tests Failed |
| 6 | Ireland | 48 | 24% | Some Accessibility Tests Failed |
| 7 | Iceland | 70 | 25% | Some Accessibility Tests Failed |
| 8 | Germany | 198 | 26% | Many Accessibility Tests Failed |
| 19 | Italy | 62 | 26% | Many Accessibility Tests Failed |
| 10 | Poland | 14 | 27% | Many Accessibility Tests Failed |
| 11 | Norway | 105 | 27% | Many Accessibility Tests Failed |
| 12 | EU level sites | 142 | 28% | Many Accessibility Tests Failed |
| 13 | Austria | 197 | 28% | Many Accessibility Tests Failed |
| 14 | Slovenia | 36 | 28% | Many Accessibility Tests Failed |
| 15 | Switzerland | 354 | 29% | Many Accessibility Tests Failed |
| 16 | Portugal | 51 | 30% | Many Accessibility Tests Failed |
| 17 | France | 258 | 30% | Many Accessibility Tests Failed |
| 18 | Cyprus | 28 | 31% | Many Accessibility Tests Failed |
| 19 | Belgium | 187 | 31% | Many Accessibility Tests Failed |
| 20 | Hungary | 171 | 32% | Many Accessibility Tests Failed |
| 21 | Luxembourg | 73 | 34% | Many Accessibility Tests Failed |
| 22 | Romania | 16 | 34% | Many Accessibility Tests Failed |
| 23 | Spain | 22 | 35% | Many Accessibility Tests Failed |
| 24 | Bulgaria | 7 | 38% | Many Accessibility Tests Failed |
| Europe Average | 2198 | 28% | Many Accessibility Tests Failed |
Disclaimer
From some countries we collected and evaluated less than five web sites. Results from these countries have deliberately been removed as evaluation results from five or less web sites are too little data to give any statistical significance for the country.
The data presented here is provided for informational use only, and is based on an automated assessment of web site data to rate the content accessibility of a web site for users with disabilities. The system that produces the data has bugs, flaws, and omissions, both known and unknown. Data collection and assessment are performed over an extended time, and thus the score given to a web site may not correspond to the current state of that web site. Thus, the data may not be reliable, and there is no warranty for its accuracy and completeness. EIAO and its associated institutions offer no warranty and make no claim of usability or merchantability and cannot be held responsible for any damages, even in the case of negligence. You must bear the entire legal liability for damages stemming from your use or distribution of the data.
Technical Data
The results have been obtained following the methodology defined in Unified Web Evaluation Methodology 1.2 (UWEM) and its statistics companion as sampling is used. The assessment is intended to conform to the Web Content Accessibility Guidelines 1.0 (WCAG10). The evaluation results have been obtained following the methodology defined in UWEM and its statistics companion as sampling They are based on automatic testing only and therefore cover only the tests defined as automatable in UWEM the remaining ones In addition web sites' compliance with such accessibility tests does not guarantee successful experience for each web site visitor as this might be impacted by individual specific conditions or environment. Regarding the regional or sectoral representativeness, it is also currently limited by the sample of sites used in each category and the sample of pages used included in the evaluation from each site.
Please see the Frequently Asked Questions for further details.
News
EIAO continued.
The EIAO results are continued with two new projects:
Online Reporting Tool
The experimental Online Reporting Tool. Please note that this tool is not yet fully accessible and will be updated.
EIAO Final Report
The EIAO Final Reports have been submitted. The final list of deliverables is available under resources.
EIAO in final phase
The EIAO project is now in the final reporting phase and the final review will be carried out in the end of May.




