Designing Efficient Examinations with Scanner-Based Exams

With the examination software EvaExam, scanner-based exams can be efficiently created on a computer and partially get marked automatically after the examination. This saves time during what is often an already hectic examination phase. In this article, we present the advantages of using scanner-based exams to assess students.

What are the advantages of scanner-based exams?

The entire process – from developing an exam to grading it – can be made (more) time-efficient, for example through question pools, the partially automated grading of examination questions or the automatic compilation of a data overview containing student ID numbers, credits and grades. The grading effort for exams, as well as errors in the process, are minimized, for example through the automat–ed marking and addition of points to calculate the total score. The quality of questions and responses can be better analyzed and optimized using the statistical indicators item difficulty and item discrimination or by examining the frequency distribution of the answers selected for each question.

Which software can I use?

Before deciding on an examination format, it is important to clearly define the learning outcome of the course or module. Based on this, a proficiency level model or criteria matrix is drawn up. You can then determine what a suitable examination format would look like. For digital examination formats, the two electronic examination systems EvaExam and ILU-EA are suitable. Access to EvaExam is provided via the manufacturer’ website and must be accessed from the university’s network or via VPN. After logging in, you can find instructions in the Extras section of the EvaExam software under Help. In the Info section, you can download the user manual.

EvaExam and ILU-EA in comparison

EvaExamILU-EA
Software maintenance and customizationBy evasys GmbHBy Campus IT of TH Köln
Operation and data storageOn servers operated by Campus IT at TH KölnOn servers operated by Campus IT at TH Köln
Exam creationIn a web browser, accessed from the university’s networkIn a web browser
Question typesSingle Choice, Multiple Choice, Kprim Choice, Matching Question, True/False Question, Open-Ended Question, Segmented Open-Ended Question, Hotspot QuestionTest object: Single Choice, Multiple Choice, Kprim Choice, Horizontal and Vertical Ordering Question, Matching Question, Hotspot/Imagemap, Error Text, Text Subset Question, Cloze Question, Formula Question, Numeric Question, Essay Question, File Upload Question; Exercise object
SettingsQuestions and answers can be randomized (individual questions can be fixed); points awarded per question or answer; no restriction on the number of answers that can be selected in multiple-choice questionsQuestions and answers can be randomized (individual questions cannot be fixed); points awarded per question or answer; number of answers that can be selected in multiple-choice questions can be restricted
Design of the examination viewCustomizable examination view; design using various elements such as question groups, dividing lines, texts and imagesExamination view can hardly be customized; questions can be designed using elements such as texts and images
Examination conductionPrinted on paperIn a web browser (completion of Test Objects, upload for Exercise Objects)
Examination gradingPartially automated in the web browser, accessed from the university’s network; open-ended questions can be marked directly on the exam sheet, using the answers captured automatically by the scanner (in some cases) or using answers entered manually into the softwarePartially automated in a web browser; open questions can be assessed manually using the software
Suitable examination formatsScanner-based exam (under supervision)E-exam (under supervision), other written (remote) examination formats such as term papers, open-book assignments

Step by Step

Please remember to test the procedure for conducting a scanner-based exam and practice how to tick the boxes to correctly enter student ID numbers and answers with your students! To do so, please provide students with the following information in German or English.

  • If you do not yet have an examiner account in EvaExam, ask the administrator responsible for your faculty’s department (see list below) to create one for you. The department administrators can assist you with questions regarding scanner-based exams and EvaExam. In the event of malfunctions or error messages, please contact Campus IT Service Desk.
  • Create an examination sheet with questions in the software.
  • Create a specific examination from this examination sheet and the questions it contains.
  • Print the examination sheet in the required quantity. Do not copy it, as this may cause errors when scanning the sheets after the examination!
  • Conduct your examination.
  • Scan the completed examination sheets at a scanning station. You can find an overview of their locations below.
  • Have EvaExam verify any selections on the examination sheets that were automatically identified as uncertain.
  • Manually award points for any open-ended questions in the exam using the software.

Additional information

  • Faculty of Applied Social Sciences (F01): Bernhard Wilmes
  • Faculty of Cultural Sciences (F02): vacant
  • Faculty of Information and Communication Sciences (F03): vacant
  • Faculty of Business and Law (F04): Ursula Binder
  • Faculty of Architecture (F05): vacant
  • Faculty of Civil Engineering and Environmental Technology (F06): Isabelle Dembach
  • Faculty of Information, Media and Electrical Engineering (F07): vacant
  • Faculty of Automotive Systems and Production (F08): Daniela Weigmann
  • Faculty of Plant, Energy and Mechanical Systems (F09): Andreas Josef Kaluza
  • Faculty of Computer Science and Engineering Science (F10): Albert Hamidullin
  • Faculty of Applied Natural Sciences (F11): Dirk Burdinski
  • Faculty of Spatial Development and Infrastructure Systems (F12): vacant
LocationRoomContact personFaculties using the station
IWZHO-02-107Daniela Weigmann, Jochen BlaurockFaculty of Information, Media and Electrical Engineering (F07), Faculty of Automotive Systems and Production (F08), Faculty of Plant, Energy and Mechanical Systems (F09)
IWZ-Old BuildingRoom 212cIsabelle Dembach, Dieter HerbeckFaculty of Architecture (F05) / Faculty of Civil Engineering and Environmental Technology (F06)
U48Room 34.1Bernhard Wilmes, Jürgen SleegersFaculty of Applied Social Sciences (F01) / Faculty of Information and Communication Sciences (F03) (ITMK)
GMRoom 2.236Albert HamidullinFaculty of Computer Science and Engineering Science (F10)
LEVBuilding 28, Room 05Emily KobsFaculty of Applied Natural Sciences (F11)
CL1B1 65A Service Center F04Ronald FrerichFaculty of Information and Communication Sciences (F03) (IIM) / Faculty of Business and Law (F04)

Header image: AI-generated with Adobe Firefly

  • M. A., research assistant at the Center for Academic Development at TH Köln. Responsible for the area of e-assessment. Member of the network Gesellschaft für Medienpädagogik und Kommunikationskultur (GMK). Main areas of work: Coordination, conception, consulting and training in the context of e-examinations, examination didactics and related platforms (ILIAS, EvaExam), coordination of the expert group on simulations and learning games in teaching.

Learn more. Teach better!

You might be interested in this content. Articles and instructions on digital tools and good practice examples with a high didactic effect.

We appreciate your feedback!

When developing this offer, we tried to include you as a teacher in advance. We would therefore be delighted if you would help us to further improve our offer. Please let us know what you would like, what bothers you or what you particularly like.

Would you like to contact us directly? Then write to us at lehrpfade@th-koeln.de!