©Radiometer

Draft

One-page executive summary

Date of the AB-test:

Location of the AB-test:

Test participants:

Names and initials of the facilitator and note taker:

Fill in when the AB-test is complete

Question(s) answered:

  • Copy/paste from the Planning Document for AB-testing of… for the test

Material:

  • Copy/paste from the Planning Document for AB-testing of… for the test

Independent and dependent variable:

  • Copy/paste from the Planning Document for AB-testing of… for the test

Main findings:

  • Main answers to the question, supported by a p-value if possible.
  • Main observed information.
  • Additional information.

Recommended actions:

  • If any…

AB-Testing of______

To guide you in filling out this template, use the Guidelines for conducting an AB-test.

Guidance text is written in gray and can be deleted.

Tailor as appropriate.

Before the AB-test fill in the “Planning of the AB-testing of…”

After the AB-test fill in the “Report for the AB-testing of…” and the “One-page executive summary”

Planning of the AB-testing of ______

Purpose and topic:

Question(s) answered:

  • What is the question we would like to have answered?
  • Why is this of importance?

Material:

  • Which type of material you have present to make the experiment – is it e.g. print out of screen shots, is it a click dummy or is it working code?
  • Difference between the two designs.

Independent and dependent variable:

  • Define the independent variable (what you test) and the dependent variable (what you measure).

Specify the experimental plan:

Experiment type:With-in subject: ______Between subject: ______

Given task:

  • Describe the task the test participants is asked to perform? (E.g. enter a name and click “okay”, conduct a whole maintenance workflow, etc.).

Location:

  • State where the experiment should be performed (at your desk, in the canteen, at a hospital ward?)

Test participants:

In-house: ______External: ______

Number of test participants: ______

Background of the test participants: ______

Remember: If the test participants are not from in-house they have to sign aDeclaration of Consent and a NDA. Contact information to “Global Legal” can be found on the Intranet.

Collecting Data

Type of data:

Video: ______; Notes: ______; Sound:______; Counting:______

Qualitative: ______; Quantitative: ______

Statistics:

Which type of data analysis will be applied to analyze the data?

Test plan

The test plan should include:

  • Introduction (see appendix II in “Guidelines for Conducting an AB-test”)
  • If outside Radiometer: Declaration of consent (see appendix III in “Guidelines for Conducting an AB-test”) and an NDA (contact the Legal Department)
  • Pre-questionnaire (see appendix IV in “Guidelines for Conducting an AB-test”)
  • Run the experiment (see Test Script below)
  • Debriefing and post-questionnaire: (see page 9 and Appendix IV in “Guidelines for Conducting an AB-test”)

Test script

Step / Action / Expected result / Result
1. / The participant is asked to…
2

Responsibilities

Name / RMED Initials / Responsibilities

Report for AB-Testing of ______

Findings

Statistics

List the means of the dependent variable

  • If possible make a t-test or ANOVA and state the p-value

Answers from the questionnaires

  • List answers from the pre- and post-questionnaire, e.g. make use of descriptive statistics.

Observations

  • List observations made during the AB-test. Use bullet points.

Additional information

  • List any additional information from the workshop, e.g. quotations from the participants.Use bullet points.

Conclusions

  • State the results from the AB-test, supported by e.g. the means, the p-value and/or the observations.