Unlock the Future of Slide Scanning at the International Scanner Benchmark 2025!
We invite all slide scanner manufacturers to join the International Scanner Benchmark 2025, hosted by EMPAIA International. Building on the success of our previous Scanner Contest, this benchmark has been instrumental in driving innovation and enhancing scanner technology, delivering valuable insights for both manufacturers and users alike.
In this new 'Benchmark' format, our goal is to provide you with neutral, detailed evaluations and feedback.
Each participant will receive a comprehensive performance report for their scanners across multiple domains.
In those individually, for every vendor generated, benchmarks the results for other vendors, except rank 1-3 will be made anonymous.
And of course, we’ll be celebrating excellence with public awards in various categories at the ECDP2025 in beautiful Barcelona! Don’t miss this opportunity to showcase your technology and push the boundaries of scanner innovation.
No
1
2
3
4
5
Domain
High Throughput
Quality
Description
Survey towards throughput, 20x / 40x
Survey towards quality, 20x / 40x
Cytology
Survey towards relevance of features
Technical
Colour calibration slide
Power consumption, acoustic camera
Design and Usability
Survey towards user experience
Criteria
Speed, focus, completeness, stitching
Manual quality assessment
Feature scoring scheme
Scanning area, colour fastness, power consumption, noise emission
System usability scale
General Rules
Each company is invited to participate in any of the offered domains with one or more scanners.
The organising committee provides all glass slides.
Independent referees who will be responsible for handling the slide series and time measurements supervise the contest.
The participants will have the possibility to review and comment on the evaluated results.
What Does It Cost?
The International Scanner Benchmark 2025 incurs expenses that must be covered. While it operates as a non-profit event, we still need to offset costs such as venue, referees, support staff, and the evaluation process, including software.
These costs are covered through participation fees, which are as follows:
5,000 € basic fee per participating company
5,000 € basic fee per scanner per company
2,500 € per domain per scanner
The Schedule
Phase 1 – Registration
September 2024: Finalisation of contest domains and the overall schedule.
December 1, 2024: Deadline for scanner vendor registration. Vendors are encouraged to select their preferred contest domains during registration. Multiple devices can be registered across different domains.
December 31, 2024: Deadline for scanner vendors to pay registration fees.
Phase 2 – Test And Evaluation
Scanner vendors will transport their participating devices to an evaluation lab for one week. These labs will be located at EMPAIA reference centres and will be selected in collaboration with the manufacturers preferences. For example, it may be beneficial to combine the evaluation of a scanner with a test installation at one of our reference centres. During the test week, scanners will undergo thorough evaluation and testing by our technical team, supervised by referees and medical experts. We recommend that one of your support technicians be present for the first two days to assist with setup and troubleshooting.
The evaluation period is scheduled between January 13th and April 12th.
Phase 3 – Presentation Of Results, Award Ceremony
The award event is scheduled to coincide with the ECDP2025, taking place from June 25-28 in Barcelona, Spain. Results will be presented, and awards will be given during a dedicated session.
Detailed benchmark reports for each scanner manufacturer are provided confidentially.
Who To Contact?
For further questions, please contact us via scanner-benchmark@empaia.org or don’t hesitate to call Nora Anna Enzlberger, Office Director EMPAIA International e. V., at +49-175-958 39 66