Logo Utrecht University

Educate-it supportsite: digital assessment with Remindo

Vragen maken

Back

Creating a new question

In this item, we will explain what steps must be taken to create a new question in Remindo. We will also cover some of the settings that will require configuration in (nearly) every type of question.

  • Step 1

    • Log in to admin view and go to Tests.
    • Select your faculty.
    • Under Categories, select the course you want to create a new question for. The course you select will be highlighted in yellow. New questions will be added to that course’s item bank.

  • Step 2

    • Click Add question (top right corner of the screen).

  • Please note! The Add question button will not work until you have selected the course to which your new question should be added.

  • Step 3

    • A new screen will open (see image).
    • Select the form of your question under Type of question. A multiple-choice question was chosen for the example.
    • Enter the name of your question under Code.
    • If you set the options Available for use in paper exams, Available for practice and/or Available for exams to No, the question will be unavailable for those uses. For example, questions made unavailable for exams cannot be selected when designing an exam (see recipe).
    • Language: choose whether the question should be denoted as Dutch or English by using a flag.
    • Under Show calculator aid?, select whether the student will be allowed to open the calculator while performing the exam. Choose whether they will have access to the simple or the scientific calculator. Please note! These settings can be modified during the creation of an exam: the global exam settings will override settings in the question. See Recipe:create.
    • Click Add when you have entered and checked everything.

  • Tip! Give the question a name that makes sense in the Code field. You could use the subject of your question, for instance. This will make it easier to find your question again later using Remindo’s search function. Besides, questions without a unique name cannot be distinguished from each other in the Learning Analytics (test analysis in Student view).

    You can also add properties to the question to help identify it later. In Veterinary Medicine, the questions were tagged based on species and/or organ system.

     

  • Tip! When editing (see step 4 below) you can add another ‘question type’ when using the multiple-choice question and the matching question.

    • If you ‘add question’ and choose the (a) multiple-choice question with one correct answer, you can still switch to the (b) multiple-response question with multiple correct answers or the (c) multiple-response question with multiple correct answers (limited) in the editor. Switching from (b) to (a) or (c) is also possible.
    • If you ‘add question’ and choose the matching question, you can set up the following variations in the editor: only one connection is possible in the entire matrix; only one connection is possible per row/column; multiple connections per row/column are possible.

     

  • Step 4

    • You will come to the Edit question screen to enter your question (stem and distractors).
    • Each type of question in Remindo has characteristics and settings that are specific to that question type. These specific settings are described in the section on that question type.
    • A number of settings are common to (almost) every type of question. These settings are briefly discussed below, using the example of a multiple-choice question.

  • Step 5

    Question stem: Each question type has two fields for entering the stem of the question. These fields contain brief hints about how to construct or use the question. The first field, with the text ‘This is the standard text’, appears in nearly every type of question (see next image).

    The hint in the second field differs from question type to question type. For example: ‘Which is the correct answer?’ (multiple-choice question), ‘Which items belong together?’ (connect-the-dots question) or ‘Match each row with its correct answer.’ (Matching question).

    Enter question stem: Click the pencil next to where it says ‘This is the standard text’ or ‘Which is the correct answer?’ A text edit box will activate on the right side of the screen. Enter the question stem into that box.

    Distractors: Multiple-choice questions, multiple-response questions, sorting questions and matching questions require that you enter distractors.

    Enter distractors: Click the pencil icon to the left of the distractor. Enter the distractor in the text edit box to the right. When you click the next distractor, the previous one will be saved automatically.

    You have to enter the correct answer along with the other distractors. You will indicate which one it is later on.

    To see whether all distractors have been added correctly, click refresh at the bottom left of the screen.

    Please note: the word ‘distractor’ may be confusing, since it also applies to the correct answer. You will indicate which distractor is actually the correct answer in a later step.

    Please note: If you prepare your questions in Word, be aware that Remindo will retain Bold and Italic formatting when you paste text in. If you used that formatting to mark your correct answers in Word, you will need to remove it in Remindo. Remindo will not retain Underline, Highlight or coloured text formatting.

  • Please note! The box containing the text ‘This is the standard text’ does not exist when choosing the text-entry question, due to the specific way in which this question type is designed. The box containing the text ‘which is the correct answer?’ does not exist for each question type due to the specific ways in which these question types are designed.

  • Tip! Remove the placeholder texts ‘This is the standard text’ and ‘Which is the correct answer?’ with a single click by clicking the empty page icon at the top left corner of the text edit box (see purple circle).

  • Step 6

    Indicate correct answer and configure scoring.

    • To indicate the correct answer and configure the Scoring for the question, click the pencil icon in the top left corner of the box containing all the distractors (see image).

  • Please note! During the exam, Remindo does not automatically show the number of points to be obtained per question. If you want to communicate the number of points to students during the exam, you should indicate how many points a question is worth in the question text, while creating the question.

    The number of points to be obtained in the whole exam can be found on the page Introduction to recipes and guide to recipe functions, under ‘Preview’.

  • Step 7

    A new screen will open.

    Field: Options

    • Under Question types, you can switch between a multiple-choice question with one correct answer to a multi-response question with multiple correct answers (limited) (and vice versa)
    • Under Shuffle, indicate whether the order in which the distractors appear should be shuffled during the exam (only applies to multiple-choice, multiple-response and matching questions).
    • Please note! Disable shuffling of distractors when the question is true/false, concerns a numerical sequence or involves some other logical sequence that should appear in a set order.

    Field: Scoring

    • You can use various types of scoring in Remindo, depending on the type of question. Click here to see a brief description of the different score types. They are: correct answer, score distribution, product rule and quotient rule.
    • You can also see question scores when clicking on Scoring. Depending on the question type and type of scoring, you can fill in and view the following scores: Standard scores, Basic scores, Minus scores, Total scores, End scores, and Bonus scores. For more details on the scores per question type, please click here.

  • Step 8

    Indicate which is the correct distractor by checking the box Correct next to that distractor. In a multiple-response question, multiple distractors can be marked as correct.

    For each distractor, you can use the Fixed option to ensure it appears in a set position. The other distractors will still appear in random position.

     

    Feedback can be added to each of the distractors in a multiple-choice or multiple-response question. The candidate will see this feedback if they are allowed to see the results.

    Offering General feedback: instead of providing feedback for each distractor separately, you can provide general feedback for when the candidate offers the correct answer and for when they get (parts of) it wrong. This is possible for all question types.

    Use the Add choice button to add extra distractors. Matching questions have Add row and Add column buttons.

    You can remove distractors with the trashcan icon to the right of each.

    Please note! Disable shuffling of distractors when the question is true/false, concerns a numerical sequence or involves some other logical sequence that should appear in a set order.

  • Step 9

    • Adjust the order in which the distractors appear by dragging them around with the arrow buttons.

  • Step 10

    When you have configured everything, click Save question in the bottom right of the screen. By default, you will see a pop-up message asking for a description of the changes you made to help with version tracking. Enter such a description if you wish, then click Add question. The question has now been created and can be found in the item bank.

    If you have already saved this question before, you can also save it as a new copy instead.

Back