The final BITV-Test

The final BITV-Test offers website owners an assessment of the state of accessibility of their new or re-launched website.

The legal basis: BITV

The final BITV-Test is based upon the Barrierefreie-Informationstechnik-Verordnung (BITV 2.0) vom 21. Mai 2019, a directive which mandates accessibility for all internet sites of German federal administrations.

The scope of testing

The scope of the website to be included in the final test is defined in co-operation with the website owner. Usually, it is the entire website including historical sections and sections that contain documents for download, for example, in PDF format.

The page sampling is carried out independent of the website owner. Evaluators determine the total number of pages in the sample with regard to the complexity of the site and the number of different templates used. If present, pages with data tables, search results or multimedia content as well as integrated functions and services should be included (e.g., user comments or local search). Different viewport widths are included in the test.

When testing web applications, all relevant aspects of selected processes must be included in the page sample. Evaluators include dynamically displayed content as additional states during page sampling. They describe the states and document the way they can be called up. Checkpoint ratings and comments pertaining to dynamic states of a page should clearly reference the respective state.

If any aspect of a web site is to be excluded, this has to be clearly stated in any publication of the test results.

Tandem testing

The final BITV-Test is a tandem test, in other words, two qualified evaluators test independent of each other and harmonise their results only once they have finished their respective test runs. 

Tandem testing increases the reliability of test results. Sometimes, one evaluator will have spotted something that the second evaluator has failed to notice. In addition, there are sometimes differences regarding the assessment of aspects of implementation that can be sorted out in the arbitration phase.

The more comprehensive tandem test may sometimes unearth more accessibility issues than preceding design support tests of the same site, leading to a worse result.

The assessment

The basis of the assessment is the procedure laid out in the inventory of test steps. Some of the 60 checkpoints refer not to individual pages but to the entire site.

For the overall assessment of a site, the results of the 60 checkpoints are added. WHile the published result only shows which SCs per page were rated as conformant and as non-conformant. Customers have access also to the more fine-grained assessment of content based on a five point Likert scale rating that helps prioritise remediation efforts

Publication of results: the seals 'BITV konform' and 'BITV-Test Prüfergebnis'

The client receives a detailed PDF test report that documents ratings and comments per checkpoint and page. The report will usually also include recommendations.

Website owners can publish the results of successful BITV final tests to document conformance to BITV 2.0 or WCAG 2.1 via the 'BITV konform' seal or via  a seal 'BITV-Test Prüfergebnis' which does not prove konformance but links to a detailed report tht shows what did and what did not conform. A publication of results must not be selective: the complete result of the test report must be provided.

In case of a successful test result, website owners can place the 'BITV konform' logo on their web site to reference the test result. In addition website owners can ask for inclusion of their site in the list of accessible websites, Sites & Agenturen.

Limits of the test

The idea of the BITV-Test is that it can be carried out with reasonable effort. This is why the test focuses on a representative sample of pages. The downside of sampling is that not all deficiencies may have been captured. Moreover, the test result is a snapshot documening the site's accessibility at a given point of time only. As the site and its content change, the test result may quickly become outdated. 

Final test or design support test?

Our experience shows that it is usually recommended to carry out a design support test to remedy exisiting deficiencies before embarking on a final test. It is then more likely that the final test will lead to a good or very good result.