{"id":108,"date":"2021-11-11T13:57:50","date_gmt":"2021-11-11T18:57:50","guid":{"rendered":"https:\/\/openstudio.pub\/hqoc\/chapter\/2-5-providing-feedback-feedforward-and-assessing-performance-events-7-8\/"},"modified":"2023-07-07T23:06:17","modified_gmt":"2023-07-08T03:06:17","slug":"2-5-providing-feedback-feedforward-and-assessing-performance-events-7-8","status":"publish","type":"chapter","link":"https:\/\/openstudio.pub\/qualitycourses\/chapter\/2-5-providing-feedback-feedforward-and-assessing-performance-events-7-8\/","title":{"raw":"2.5 Providing feedback\/feedforward and assessing performance (Events 7 &amp; 8)","rendered":"2.5 Providing feedback\/feedforward and assessing performance (Events 7 &amp; 8)"},"content":{"raw":"<strong>Gagn\u00e9's Event 7: Provide Feedback<\/strong>\u00a0and <strong>Event 8: Assess Performance<\/strong> encourage instructors to give learners a variety of ways to demonstrate their understanding and achievement of learning outcomes. Effective assessment in online courses is\n<ul>\n \t<li>distributed throughout the course,<\/li>\n \t<li>linked to learning outcomes, and<\/li>\n \t<li>offers learners many chances and methods to demonstrate their learning.<\/li>\n<\/ul>\nScaffolded assignments can help you assess a learner\u2019s performance toward an outcome by illustrating their progress.\n\n[caption id=\"attachment_105\" align=\"aligncenter\" width=\"858\"]<img class=\"wp-image-87 size-full\" src=\"https:\/\/openstudio.pub\/wp-content\/uploads\/sites\/14\/2023\/07\/gagne-designdevelop-event7-8.png\" alt=\"Event 7 and 8 of the deliver phase: Provide Feedback and Assess Performance.\" width=\"858\" height=\"219\"> Caption: In Gagn\u00e9\u2019s Nine Events of Instruction framework, Event 7 focuses on providing feedback and Event 8 focuses on assessing performance.<br>Credit: University of Waterloo | <a href=\"https:\/\/openstudio.pub\/wp-content\/uploads\/sites\/14\/2023\/07\/Gagnes-nine-events-7-8-d.pdf\" target=\"_blank\" rel=\"noopener\">Image Description<\/a> (PDF)[\/caption]\n<h2><a id=\"Strategies-for-grading-and-providing-feedback-online\" href=\"\"><\/a>Strategies for grading and providing feedback online<\/h2>\n<blockquote>Assessment without timely feedback contributes little to learning.\n<p class=\"copyright\">(Chickering &amp; Gamson, 1987, p. 4)<\/p>\n<\/blockquote>\nResearch has shown that providing effective feedback and feedforward can produce greater learning and helps students gauge whether or not they are meeting the course learning outcomes (Concordia University, 2021). By encouraging learners to reflect on their performance, and to course-correct when necessary, meaningful feedback can enhance critical thinking, reflective practice, and help learners and instructors build trust (Rottman &amp; Rabidoux, 2017).\n\n<strong>Effective feedback is<\/strong>\n<div class=\"list-box-actionable\">\n<h3>actionable<\/h3>\nProvide concrete and specific feedback with actionable items learners can apply when completing their next assignment.\n\n<\/div>\n<div class=\"list-box-intelligible\">\n<h3>intelligible<\/h3>\nEnsure that your feedback is easily understood and be careful not to overwhelm learners\u2014too much feedback can be counterproductive, so concentrate on key elements of performance (Wiggins, 2012).\n\n<\/div>\n<div class=\"list-box-timely\">\n<h3>timely and ongoing<\/h3>\nActionable and intelligible feedback allows learners to implement changes on drafts or future assignments. Timely and ongoing feedback is equally important and helps learners move forward with their learning (Rottman &amp; Rabidoux, 2017). Learners benefit from opportunities to adjust their performance in order to meet criteria for success (Wiggins, 2012). Learners who do not receive feedback at regular intervals may flounder, especially in an online course where opportunities for peer-to-peer and learner-to-instructor engagement may be limited (Center for Academic Innovation, University of Michigan, 2020).\n\n<\/div>\n<div class=\"list-box-consistent\">\n<h3>consistent<\/h3>\nConnect feedback to learning outcomes and clearly outline criteria for success in assignment instructions and rubrics (Wiggins, 2012; Center for Academic Innovation, University of Michigan, 2020).\n\n<\/div>\n\n[caption id=\"attachment_105\" align=\"alignright\" width=\"165\"]<img class=\"size-full wp-image-99\" src=\"https:\/\/openstudio.pub\/wp-content\/uploads\/sites\/14\/2021\/11\/discussion-feedback.png\" alt=\"\" width=\"165\" height=\"142\"> (\"discussion\" icon by Berkah Icon, from the Noun Project. Used under CC BY 3.0 license.)[\/caption]\n\nProviding feedback is <strong>especially<\/strong> important in online courses, because \u201csometimes the only perceived interaction a learner may have with an instructor is through feedback\u201d (Center for Academic Innovation, University of Michigan, 2020). Providing feedback helps to <strong>build connections<\/strong> between instructors and learners, <strong>encourages learner engagement<\/strong>, and <strong>fosters online learning communities<\/strong> (Centre for Teaching and Learning, Concordia University\/Universit\u00e9 Concordia, 2021).\n\nYou might also consider the feedback you provide as a dialogue with your learners. Offer your perspective on how their work connects to the course goals and have them engage in metacognitive reflection about their learning and how they can take their learning forward to the next task\/assessment. This reflection can also be submitted as a follow-up assignment.\n\n&nbsp;\n\n&nbsp;\n<div class=\"edii-box\">\n<h2><a id=\"Feedback-formats\" href=\"\"><\/a>An EDII perspective: Feedback formats<\/h2>\nMost instructors are used to providing written feedback as it is the most common feedback provided in \"hand-in\" assessments.\n\nIn an online course, instructors can easily provide written (i.e., annotate the document directly or produce summary feedback), verbal, or video feedback. Audio or video feedback may be quicker to record than typing up comments, and allows learners to hear your tone better (<a href=\"https:\/\/onlineteaching.umich.edu\/giving-good-online-feedback\/\" target=\"_blank\" rel=\"noopener\">Center for Academic Innovation, University of Michigan, 2020<\/a>).\n<img class=\"alignright size-full wp-image-100\" src=\"https:\/\/openstudio.pub\/wp-content\/uploads\/sites\/14\/2023\/07\/media.png\" alt=\"\" width=\"96\" height=\"96\">\nFeedback through audio or video can be particularly helpful when working with English-language learners, international students, or with assessments where learners are asked to be particularly vulnerable, such as through creative writing, performance, or reflexive practice. By using audio or video for feedback, you can then convey your appreciation of their contribution and the difficult work they put in to complete the assignment. The multiple means of producing feedback may also help you provide feedback to learners with accommodations (e.g., due to disability) in a format that they can more easily access.\n\n<img class=\"alignright size-full wp-image-101\" src=\"https:\/\/openstudio.pub\/wp-content\/uploads\/sites\/14\/2023\/07\/sandwich.png\" alt=\"\" width=\"96\" height=\"96\">\n\nRegardless of the medium, pay special attention to how you structure your feedback given that tone can sometimes be difficult to detect (especially in written formats). A common approach is the \"sandwich\" method: opening with positive feedback, followed by the core constructive pieces, and ending again on a positive note. Feedback can also be offered in one-on-one meetings or peer-feedback elements can be integrated into assignments and activities (<a href=\"https:\/\/onlineteaching.umich.edu\/giving-good-online-feedback\/\" target=\"_blank\" rel=\"noopener\">Center for Academic Innovation, University of Michigan, 2020<\/a>).\n\n<\/div>\n<h2><a id=\"Examples-of-how-online-feedback-and-grading-could-work\" href=\"\"><\/a>Examples of how online feedback and grading could work<\/h2>\n<div class=\"advanced\">\n\nQuality Advanced\n<h3>Example 1: Using peer feedback to improve work prior to formal assessment<\/h3>\nAn advantage of an online course is that there are many ways assignments can be shared among peers, even without third-party tools. A simple approach using only the learning management system (LMS) could be to scaffold an assessment with peer review. Place learners into small group discussion forums where they can submit the first draft of their assignment. Peers in this small group can use a formal rubric to help the original authors improve their work.\n\nEnsure that the goal of these types of exercises are clear. Learners should not be asked to evaluate each other's work in the same way you would, as they generally feel ill-equipped to do so. Instead, ask them to analyze or react to their peers\u2019 work, i.e.,\n<blockquote>to find the thesis statement, the evidence, and the main conclusion, or to identify the \u2018strongest sentence,\u2019 a particularly persuasive piece of evidence, and [anything] that the reviewer had to read more than once to understand.\n<p class=\"copyright\">(Nilson &amp; Goodson, 2018, p. 150)<\/p>\n<\/blockquote>\nThis kind of feedback helps peer authors to recognize the areas in the work that may not have been clearly communicated. The reviewing peer might also be evaluated using a second rubric, which focuses on\n<ul>\n \t<li>the clarity of their feedback,<\/li>\n \t<li>whether the feedback uses course-appropriate language and terms, and<\/li>\n \t<li>whether it demonstrates an approach that is intended to help the original author improve their work.<\/li>\n<\/ul>\nThis type of exercise helps build professionalism and communication skills as well as improve the quality of the final product across the class.\n\n<strong>Tips:<\/strong>\n<ul>\n \t<li>If you intend learners to formally evaluate their peers using a rubric and generate a \"grade,\" then it is recommended that they submit this grade privately to the instructor, while keeping the summary of written feedback public to the small group and\/or the individual learner. In this way, you prevent learner\u2013learner tensions or pressures to \"give high marks,\" and as an instructor you can ensure the \"grade\" is aligned with the written feedback produced.<\/li>\n \t<li>Similar approaches can be used with third-party peer-evaluation tools. These technologies can be more or less intuitive to use, so evaluate functionality closely to ensure it effectively meets your needs. A familiar \"low-tech\" solution using the LMS is more helpful to learners than a confusing or disorienting third-party application experience.<\/li>\n<\/ul>\nHere is an example of a rubric to evaluate peer reviewers and their ability to provide constructive written feedback (approximately 250 words) to a narrated PowerPoint presentation summarizing a journal article prepared by a peer.\n<ul>\n \t<li><a href=\"https:\/\/openstudio.pub\/wp-content\/uploads\/sites\/14\/2023\/07\/Peer-Reviewer-Critique-Evaluation-Rubric.pdf\" target=\"_blank\" rel=\"noopener\">Rubric to evaluate peer reviews of a presentation<\/a><\/li>\n<\/ul>\n<p class=\"copyright\">Credit: Dr. Prameet Sheth, Department of Biomedical and Molecular Sciences, Queen's University<\/p>\n\n<\/div>\n<div class=\"essential\">\n\nQuality Essential\n<h3>Example 2: VALUE rubrics<\/h3>\nThe<strong> VALUE Rubrics<\/strong> are a great resource for creating rubrics that assess intellectual and practical skills. You will want to ensure that your rubrics are well <strong>aligned with your learning outcomes<\/strong>\u00a0and of course the <strong>expectations you outline in the assignment instructions<\/strong>.\n<ul>\n \t<li><a href=\"https:\/\/www.aacu.org\/value-rubrics\" target=\"_blank\" rel=\"noopener\">VALUE Rubrics<\/a><\/li>\n<\/ul>\n<\/div>\n<div class=\"box\">\n<h2><a id=\"Activity-Grading-criteria\" href=\"\"><\/a>Activity: Grading criteria<\/h2>\n<strong>Learning outcomes<\/strong>\n\nThis activity is directly aligned with <strong>Course Learning Outcome (CLO)<\/strong><strong>\u00a03<\/strong>: Create a varied assessment scheme that scaffolds and supports the learning outcomes of the course and promotes academic integrity and <strong>CLO 5<\/strong>: Apply principles of Universal Design for Learning (UDL) and accessibility into your course design to ensure a more equitable learning experience.\n\n<strong>Instructions<\/strong>\n\nFor this activity, you will create grading criteria for an assessment using a template. A sample rubric has been provided to help you structure your grading criteria. The sample rubric includes grading criteria, weighting, and levels of achievement (excellent, good, developing, marginal, and does not meet criteria\/no submission). Note: points values are optional. You may instead wish to assign a holistic grade based on the overall level of achievement.\n\nThe nature of this activity does not lend itself to a usable in-line option; as a result, this activity can only be completed via the Word document download.\n\n<strong>Download<\/strong> the <a href=\"https:\/\/openstudio.pub\/wp-content\/uploads\/sites\/14\/2023\/07\/HQOC_M2_Grading_Criteria_Worksheet.docx\" target=\"_blank\" rel=\"noopener\">Grading Criteria Worksheet<\/a> (DOCX) to <strong>complete offline<\/strong>.\n\n&nbsp;\n\n<\/div>\n<h2>Due dates, deadlines, and late policies<\/h2>\n<img class=\"alignright wp-image-102\" src=\"https:\/\/openstudio.pub\/wp-content\/uploads\/sites\/14\/2023\/07\/deadlines-150x142.png\" alt=\"\" width=\"95\" height=\"82\">\n\n<strong>Deadlines and weighting<\/strong>\n\nInstructors should <strong>clearly identify<\/strong> assignment deadlines, assignment weight, term test dates, and the time frame for returning learner work. Deciding on your individual policies surrounding extended and late work is an important step in your syllabus and course design.\n\n<img class=\"alignright wp-image-103\" src=\"https:\/\/openstudio.pub\/wp-content\/uploads\/sites\/14\/2023\/07\/extensions-150x142.png\" alt=\"\" width=\"95\" height=\"82\">\n\n<strong>Extensions<\/strong>\n\nThere are a number of considerations when developing an extension and late penalty policy. First, institutions and units will have their own guidelines and\/or accepted practices for extensions and late policies, so be sure to check with your home department. With institutional policies in mind, set due dates, deadlines, and late penalties with <strong>flexibility and fairness in mind<\/strong>.\n\n<img class=\"alignright wp-image-104\" src=\"https:\/\/openstudio.pub\/wp-content\/uploads\/sites\/14\/2023\/07\/flexible-deadlines-150x142.png\" alt=\"\" width=\"95\" height=\"82\">\n\n<strong>Flexible deadlines<\/strong>\n\nA learner-centred approach, with built-in flexible deadlines and less punitive late penalties, acknowledges that <strong>not all learners learn and work at the same pace<\/strong>.\n\nInstructors and teaching assistants also have to think about their own workload: multiple extension requests can be overwhelming, and flexible deadlines might be difficult for a teaching team (and for learners!) to manage. <strong>There is no one policy<\/strong> that will work for every course and it is important to <strong>explore various strategies<\/strong> to determine what will work best for your course and teaching team.\n\n<img class=\"alignright wp-image-105\" src=\"https:\/\/openstudio.pub\/wp-content\/uploads\/sites\/14\/2023\/07\/late-policies-150x142.png\" alt=\"\" width=\"95\" height=\"82\">\n\n<strong>Late policies\u00a0<\/strong>\n\nA clear extension\/late penalty policy appropriate to the course, <strong>communicated to learners<\/strong> on the syllabus and <strong>consistently applied<\/strong>, is strongly recommended.\n<h2><a id=\"Strategies-for-setting-due-dates-deadlines-and-late-policies\" href=\"\"><\/a>Strategies for setting due dates, deadlines, and late policies<\/h2>\nThere are different approaches to flexible deadlines, depending on class size, assignment type, disciplinary norms, and instructor preference. Below are a few strategies faculty have implemented in their courses\u2014this is by no means an exhaustive or prescriptive list.\n[h5p id=\"36\"]\n<h2><a id=\"Examples-of-how-deadlines-due-dates-and-late-policies-could-work\" href=\"\"><\/a>Examples of how deadlines, due dates, and late policies could work<\/h2>\n<div class=\"essential\">\n\nQuality Essential\n<h3>Example 3: \u201cOops Tokens\u201d to communicate care\/empathy<\/h3>\n\u201cOops tokens\u201d are a \u201cget out of jail free\u201d card for late assignments; you can offer students one or more per course, as described by Darby &amp; Lang (2019):\n<blockquote>Students turn in a token for a no-questions-asked deadline extension, the opportunity to revise and resubmit an assignment or otherwise make up for an unexpected challenge or honest mistake.<\/blockquote>\n<p class=\"copyright\">Credit: Nilson, 2015, as cited in Darby &amp; Lang, 2019, pp. 98\u201399.<\/p>\n\n<\/div>\n<div class=\"essential\">\n\nQuality Essential\n<h3>Example 4: Grace periods for deadlines<\/h3>\nSome instructors provide a permanent grace period for all assessments in the course. For example: \u201cAssignments handed in within 48 hours of the stated deadline will not lose marks. After 48 hours, 10-percent grade deductions will be applied per day.\u201d\n\nOther instructors may frame a similar policy with a more pragmatic reasoning applied. For example: \u201cLate assignments will be accepted without penalty up to the point that I start grading. I have set aside my Thursday afternoons to grade this semester. If you submit after this time, a 10 percent per day\u2013penalty will apply.\u201d\n<p class=\"copyright\">Credit: Jenny Stodola, Professional Development and Educational Scholarship, Faculty of Health Sciences, Queen\u2019s University<\/p>\n\n<\/div>\n<div class=\"advanced\">\n\nQuality Advanced\n<h3>Example 5: Building in an assessment window and using LMS features to minimize administrative work<\/h3>\nImagine you have a series of short formative quizzes which are completed throughout the course. There are eight quizzes, but in total only account for 10 percent of the grade (low stakes). How could you set yourself up for success and minimize the amount of minding you have to do in relation to this assessment?\n<ul>\n \t<li>To accommodate the class which may be dispersed across time zones, <strong>you set a 24-hour window<\/strong> to complete the quiz.<\/li>\n \t<li>You create a <strong>bank of questions<\/strong> for which the quiz pulls questions from for each learner, thereby increasing the academic integrity of the assignment.<\/li>\n \t<li>The quiz is designed to be <strong>automatically graded<\/strong>, or perhaps there is only one question from a set that needs to be manually graded. This reduces the grading workload for you (and the TAs).<\/li>\n \t<li>Even if the quiz can be entirely automatically graded, instead of releasing the grades to the learner the moment they finish the quiz, you <strong>set the grades to release sometime the following week.<\/strong> This allows you time to sort out any learners who may have legitimate reasons for not being able to complete the quiz during the window (e.g., they may be sick) and still have all grades released at once (i.e., you are not left managing outstanding grades). This also promotes academic integrity as learners who complete the assessment early in the window cannot inform later learners of the correct responses.<\/li>\n<\/ul>\n<p class=\"copyright\">Credit: Jenny Stodola, Professional Development and Educational Scholarship, Faculty of Health Sciences, Queen's University<\/p>\n\n<\/div>\n<div class=\"edii-box\">\n<h2>An EDII perspective on due dates and accommodations<\/h2>\nWhile deadlines are important to help guide learners in their self-directed learning in an online course, regardless of your late policy, you should explicitly note in your syllabus the <strong>disability and accessibility accommodations statement<\/strong> (or variation of) that your institution has prepared. Prior to beginning their postsecondary education, it is possible that some learners may not have considered that they may need or qualify for an accommodation in the form of adjusted deadlines. Even for learners who already know they will require an accommodation, this offers an equitable way to provide learners with important information and models responsibility for one\u2019s own learning and self-advocacy.\n\nFor example, Equity Services at Queen\u2019s University offers the following statement:\n<blockquote>Queen's University is committed to achieving full accessibility for persons with disabilities. Part of this commitment includes arranging academic accommodations for students with disabilities to ensure they have an equitable opportunity to participate in all of their academic activities. If you are a student with a disability and think you may need accommodations, you are strongly encouraged to contact Student Wellness Services (SWS) and register as early as possible. For more information, including important deadlines, please visit the Student Wellness website at <a href=\"https:\/\/www.queensu.ca\/studentwellness\/accessibility-services\" target=\"_blank\" rel=\"noopener\">https:\/\/www.queensu.ca\/studentwellness\/accessibility-services<\/a>.\"\n\n(Accessibility Hub, Queen's University, n.d.)<\/blockquote>\nInstructors at the University of Toronto are encouraged to add the following accessibility statement to their syllabus:\n<blockquote>Students with diverse learning styles and needs are welcome in this course. In particular, if you have a disability or health consideration that may require accommodations, please feel free to approach me and\/or the Accessibility Services Office as soon as possible. The Accessibility Services staff are available by appointment to assess specific needs, provide referrals and arrange appropriate accommodations. The sooner you let them and me know your needs, the quicker we can assist you in achieving your learning goals in this course.\"\n\n(Centre for Teaching Support &amp; Innovation, University of Toronto, n.d.)<\/blockquote>\n<\/div>\n<div class=\"note-box\">\n\n<strong>Key take-aways:<\/strong>\n<ul>\n \t<li>Enhance critical thinking and reflective practice in your course by providing feedback to your learners that is <strong>actionable, intelligible, timely and ongoing, and meaningful<\/strong>.<\/li>\n \t<li>Take a <strong>learner-centred<\/strong> approach to setting due dates and deadlines, embracing <strong>flexibility<\/strong> when possible and clearly identifying assignment deadlines, assignment weight, term test dates, and the time frame for returning learner work.<\/li>\n<\/ul>\n<\/div>","rendered":"<p><strong>Gagn\u00e9&#8217;s Event 7: Provide Feedback<\/strong>\u00a0and <strong>Event 8: Assess Performance<\/strong> encourage instructors to give learners a variety of ways to demonstrate their understanding and achievement of learning outcomes. Effective assessment in online courses is<\/p>\n<ul>\n<li>distributed throughout the course,<\/li>\n<li>linked to learning outcomes, and<\/li>\n<li>offers learners many chances and methods to demonstrate their learning.<\/li>\n<\/ul>\n<p>Scaffolded assignments can help you assess a learner\u2019s performance toward an outcome by illustrating their progress.<\/p>\n<figure id=\"attachment_105\" aria-describedby=\"caption-attachment-105\" style=\"width: 858px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-87 size-full\" src=\"https:\/\/openstudio.pub\/wp-content\/uploads\/sites\/14\/2023\/07\/gagne-designdevelop-event7-8.png\" alt=\"Event 7 and 8 of the deliver phase: Provide Feedback and Assess Performance.\" width=\"858\" height=\"219\" srcset=\"https:\/\/openstudio.pub\/qualitycourses\/wp-content\/uploads\/sites\/14\/2023\/07\/gagne-designdevelop-event7-8.png 858w, https:\/\/openstudio.pub\/qualitycourses\/wp-content\/uploads\/sites\/14\/2023\/07\/gagne-designdevelop-event7-8-300x77.png 300w, https:\/\/openstudio.pub\/qualitycourses\/wp-content\/uploads\/sites\/14\/2023\/07\/gagne-designdevelop-event7-8-768x196.png 768w, https:\/\/openstudio.pub\/qualitycourses\/wp-content\/uploads\/sites\/14\/2023\/07\/gagne-designdevelop-event7-8-65x17.png 65w, https:\/\/openstudio.pub\/qualitycourses\/wp-content\/uploads\/sites\/14\/2023\/07\/gagne-designdevelop-event7-8-225x57.png 225w, https:\/\/openstudio.pub\/qualitycourses\/wp-content\/uploads\/sites\/14\/2023\/07\/gagne-designdevelop-event7-8-350x89.png 350w\" sizes=\"auto, (max-width: 858px) 100vw, 858px\" \/><figcaption id=\"caption-attachment-105\" class=\"wp-caption-text\">Caption: In Gagn\u00e9\u2019s Nine Events of Instruction framework, Event 7 focuses on providing feedback and Event 8 focuses on assessing performance.<br \/>Credit: University of Waterloo | <a href=\"https:\/\/openstudio.pub\/wp-content\/uploads\/sites\/14\/2023\/07\/Gagnes-nine-events-7-8-d.pdf\" target=\"_blank\" rel=\"noopener\">Image Description<\/a> (PDF)<\/figcaption><\/figure>\n<h2><a id=\"Strategies-for-grading-and-providing-feedback-online\" href=\"\"><\/a>Strategies for grading and providing feedback online<\/h2>\n<blockquote><p>Assessment without timely feedback contributes little to learning.<\/p>\n<p class=\"copyright\">(Chickering &amp; Gamson, 1987, p. 4)<\/p>\n<\/blockquote>\n<p>Research has shown that providing effective feedback and feedforward can produce greater learning and helps students gauge whether or not they are meeting the course learning outcomes (Concordia University, 2021). By encouraging learners to reflect on their performance, and to course-correct when necessary, meaningful feedback can enhance critical thinking, reflective practice, and help learners and instructors build trust (Rottman &amp; Rabidoux, 2017).<\/p>\n<p><strong>Effective feedback is<\/strong><\/p>\n<div class=\"list-box-actionable\">\n<h3>actionable<\/h3>\n<p>Provide concrete and specific feedback with actionable items learners can apply when completing their next assignment.<\/p>\n<\/div>\n<div class=\"list-box-intelligible\">\n<h3>intelligible<\/h3>\n<p>Ensure that your feedback is easily understood and be careful not to overwhelm learners\u2014too much feedback can be counterproductive, so concentrate on key elements of performance (Wiggins, 2012).<\/p>\n<\/div>\n<div class=\"list-box-timely\">\n<h3>timely and ongoing<\/h3>\n<p>Actionable and intelligible feedback allows learners to implement changes on drafts or future assignments. Timely and ongoing feedback is equally important and helps learners move forward with their learning (Rottman &amp; Rabidoux, 2017). Learners benefit from opportunities to adjust their performance in order to meet criteria for success (Wiggins, 2012). Learners who do not receive feedback at regular intervals may flounder, especially in an online course where opportunities for peer-to-peer and learner-to-instructor engagement may be limited (Center for Academic Innovation, University of Michigan, 2020).<\/p>\n<\/div>\n<div class=\"list-box-consistent\">\n<h3>consistent<\/h3>\n<p>Connect feedback to learning outcomes and clearly outline criteria for success in assignment instructions and rubrics (Wiggins, 2012; Center for Academic Innovation, University of Michigan, 2020).<\/p>\n<\/div>\n<figure id=\"attachment_105\" aria-describedby=\"caption-attachment-105\" style=\"width: 165px\" class=\"wp-caption alignright\"><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-99\" src=\"https:\/\/openstudio.pub\/wp-content\/uploads\/sites\/14\/2021\/11\/discussion-feedback.png\" alt=\"\" width=\"165\" height=\"142\" srcset=\"https:\/\/openstudio.pub\/qualitycourses\/wp-content\/uploads\/sites\/14\/2021\/11\/discussion-feedback.png 165w, https:\/\/openstudio.pub\/qualitycourses\/wp-content\/uploads\/sites\/14\/2021\/11\/discussion-feedback-65x56.png 65w\" sizes=\"auto, (max-width: 165px) 100vw, 165px\" \/><figcaption id=\"caption-attachment-105\" class=\"wp-caption-text\">(&#8220;discussion&#8221; icon by Berkah Icon, from the Noun Project. Used under CC BY 3.0 license.)<\/figcaption><\/figure>\n<p>Providing feedback is <strong>especially<\/strong> important in online courses, because \u201csometimes the only perceived interaction a learner may have with an instructor is through feedback\u201d (Center for Academic Innovation, University of Michigan, 2020). Providing feedback helps to <strong>build connections<\/strong> between instructors and learners, <strong>encourages learner engagement<\/strong>, and <strong>fosters online learning communities<\/strong> (Centre for Teaching and Learning, Concordia University\/Universit\u00e9 Concordia, 2021).<\/p>\n<p>You might also consider the feedback you provide as a dialogue with your learners. Offer your perspective on how their work connects to the course goals and have them engage in metacognitive reflection about their learning and how they can take their learning forward to the next task\/assessment. This reflection can also be submitted as a follow-up assignment.<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<div class=\"edii-box\">\n<h2><a id=\"Feedback-formats\" href=\"\"><\/a>An EDII perspective: Feedback formats<\/h2>\n<p>Most instructors are used to providing written feedback as it is the most common feedback provided in &#8220;hand-in&#8221; assessments.<\/p>\n<p>In an online course, instructors can easily provide written (i.e., annotate the document directly or produce summary feedback), verbal, or video feedback. Audio or video feedback may be quicker to record than typing up comments, and allows learners to hear your tone better (<a href=\"https:\/\/onlineteaching.umich.edu\/giving-good-online-feedback\/\" target=\"_blank\" rel=\"noopener\">Center for Academic Innovation, University of Michigan, 2020<\/a>).<br \/>\n<img loading=\"lazy\" decoding=\"async\" class=\"alignright size-full wp-image-100\" src=\"https:\/\/openstudio.pub\/wp-content\/uploads\/sites\/14\/2023\/07\/media.png\" alt=\"\" width=\"96\" height=\"96\" srcset=\"https:\/\/openstudio.pub\/qualitycourses\/wp-content\/uploads\/sites\/14\/2023\/07\/media.png 96w, https:\/\/openstudio.pub\/qualitycourses\/wp-content\/uploads\/sites\/14\/2023\/07\/media-65x65.png 65w\" sizes=\"auto, (max-width: 96px) 100vw, 96px\" \/><br \/>\nFeedback through audio or video can be particularly helpful when working with English-language learners, international students, or with assessments where learners are asked to be particularly vulnerable, such as through creative writing, performance, or reflexive practice. By using audio or video for feedback, you can then convey your appreciation of their contribution and the difficult work they put in to complete the assignment. The multiple means of producing feedback may also help you provide feedback to learners with accommodations (e.g., due to disability) in a format that they can more easily access.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignright size-full wp-image-101\" src=\"https:\/\/openstudio.pub\/wp-content\/uploads\/sites\/14\/2023\/07\/sandwich.png\" alt=\"\" width=\"96\" height=\"96\" srcset=\"https:\/\/openstudio.pub\/qualitycourses\/wp-content\/uploads\/sites\/14\/2023\/07\/sandwich.png 96w, https:\/\/openstudio.pub\/qualitycourses\/wp-content\/uploads\/sites\/14\/2023\/07\/sandwich-65x65.png 65w\" sizes=\"auto, (max-width: 96px) 100vw, 96px\" \/><\/p>\n<p>Regardless of the medium, pay special attention to how you structure your feedback given that tone can sometimes be difficult to detect (especially in written formats). A common approach is the &#8220;sandwich&#8221; method: opening with positive feedback, followed by the core constructive pieces, and ending again on a positive note. Feedback can also be offered in one-on-one meetings or peer-feedback elements can be integrated into assignments and activities (<a href=\"https:\/\/onlineteaching.umich.edu\/giving-good-online-feedback\/\" target=\"_blank\" rel=\"noopener\">Center for Academic Innovation, University of Michigan, 2020<\/a>).<\/p>\n<\/div>\n<h2><a id=\"Examples-of-how-online-feedback-and-grading-could-work\" href=\"\"><\/a>Examples of how online feedback and grading could work<\/h2>\n<div class=\"advanced\">\n<p>Quality Advanced<\/p>\n<h3>Example 1: Using peer feedback to improve work prior to formal assessment<\/h3>\n<p>An advantage of an online course is that there are many ways assignments can be shared among peers, even without third-party tools. A simple approach using only the learning management system (LMS) could be to scaffold an assessment with peer review. Place learners into small group discussion forums where they can submit the first draft of their assignment. Peers in this small group can use a formal rubric to help the original authors improve their work.<\/p>\n<p>Ensure that the goal of these types of exercises are clear. Learners should not be asked to evaluate each other&#8217;s work in the same way you would, as they generally feel ill-equipped to do so. Instead, ask them to analyze or react to their peers\u2019 work, i.e.,<\/p>\n<blockquote><p>to find the thesis statement, the evidence, and the main conclusion, or to identify the \u2018strongest sentence,\u2019 a particularly persuasive piece of evidence, and [anything] that the reviewer had to read more than once to understand.<\/p>\n<p class=\"copyright\">(Nilson &amp; Goodson, 2018, p. 150)<\/p>\n<\/blockquote>\n<p>This kind of feedback helps peer authors to recognize the areas in the work that may not have been clearly communicated. The reviewing peer might also be evaluated using a second rubric, which focuses on<\/p>\n<ul>\n<li>the clarity of their feedback,<\/li>\n<li>whether the feedback uses course-appropriate language and terms, and<\/li>\n<li>whether it demonstrates an approach that is intended to help the original author improve their work.<\/li>\n<\/ul>\n<p>This type of exercise helps build professionalism and communication skills as well as improve the quality of the final product across the class.<\/p>\n<p><strong>Tips:<\/strong><\/p>\n<ul>\n<li>If you intend learners to formally evaluate their peers using a rubric and generate a &#8220;grade,&#8221; then it is recommended that they submit this grade privately to the instructor, while keeping the summary of written feedback public to the small group and\/or the individual learner. In this way, you prevent learner\u2013learner tensions or pressures to &#8220;give high marks,&#8221; and as an instructor you can ensure the &#8220;grade&#8221; is aligned with the written feedback produced.<\/li>\n<li>Similar approaches can be used with third-party peer-evaluation tools. These technologies can be more or less intuitive to use, so evaluate functionality closely to ensure it effectively meets your needs. A familiar &#8220;low-tech&#8221; solution using the LMS is more helpful to learners than a confusing or disorienting third-party application experience.<\/li>\n<\/ul>\n<p>Here is an example of a rubric to evaluate peer reviewers and their ability to provide constructive written feedback (approximately 250 words) to a narrated PowerPoint presentation summarizing a journal article prepared by a peer.<\/p>\n<ul>\n<li><a href=\"https:\/\/openstudio.pub\/wp-content\/uploads\/sites\/14\/2023\/07\/Peer-Reviewer-Critique-Evaluation-Rubric.pdf\" target=\"_blank\" rel=\"noopener\">Rubric to evaluate peer reviews of a presentation<\/a><\/li>\n<\/ul>\n<p class=\"copyright\">Credit: Dr. Prameet Sheth, Department of Biomedical and Molecular Sciences, Queen&#8217;s University<\/p>\n<\/div>\n<div class=\"essential\">\n<p>Quality Essential<\/p>\n<h3>Example 2: VALUE rubrics<\/h3>\n<p>The<strong> VALUE Rubrics<\/strong> are a great resource for creating rubrics that assess intellectual and practical skills. You will want to ensure that your rubrics are well <strong>aligned with your learning outcomes<\/strong>\u00a0and of course the <strong>expectations you outline in the assignment instructions<\/strong>.<\/p>\n<ul>\n<li><a href=\"https:\/\/www.aacu.org\/value-rubrics\" target=\"_blank\" rel=\"noopener\">VALUE Rubrics<\/a><\/li>\n<\/ul>\n<\/div>\n<div class=\"box\">\n<h2><a id=\"Activity-Grading-criteria\" href=\"\"><\/a>Activity: Grading criteria<\/h2>\n<p><strong>Learning outcomes<\/strong><\/p>\n<p>This activity is directly aligned with <strong>Course Learning Outcome (CLO)<\/strong><strong>\u00a03<\/strong>: Create a varied assessment scheme that scaffolds and supports the learning outcomes of the course and promotes academic integrity and <strong>CLO 5<\/strong>: Apply principles of Universal Design for Learning (UDL) and accessibility into your course design to ensure a more equitable learning experience.<\/p>\n<p><strong>Instructions<\/strong><\/p>\n<p>For this activity, you will create grading criteria for an assessment using a template. A sample rubric has been provided to help you structure your grading criteria. The sample rubric includes grading criteria, weighting, and levels of achievement (excellent, good, developing, marginal, and does not meet criteria\/no submission). Note: points values are optional. You may instead wish to assign a holistic grade based on the overall level of achievement.<\/p>\n<p>The nature of this activity does not lend itself to a usable in-line option; as a result, this activity can only be completed via the Word document download.<\/p>\n<p><strong>Download<\/strong> the <a href=\"https:\/\/openstudio.pub\/wp-content\/uploads\/sites\/14\/2023\/07\/HQOC_M2_Grading_Criteria_Worksheet.docx\" target=\"_blank\" rel=\"noopener\">Grading Criteria Worksheet<\/a> (DOCX) to <strong>complete offline<\/strong>.<\/p>\n<p>&nbsp;<\/p>\n<\/div>\n<h2>Due dates, deadlines, and late policies<\/h2>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignright wp-image-102\" src=\"https:\/\/openstudio.pub\/wp-content\/uploads\/sites\/14\/2023\/07\/deadlines-150x142.png\" alt=\"\" width=\"95\" height=\"82\" srcset=\"https:\/\/openstudio.pub\/qualitycourses\/wp-content\/uploads\/sites\/14\/2023\/07\/deadlines-65x56.png 65w, https:\/\/openstudio.pub\/qualitycourses\/wp-content\/uploads\/sites\/14\/2023\/07\/deadlines.png 165w\" sizes=\"auto, (max-width: 95px) 100vw, 95px\" \/><\/p>\n<p><strong>Deadlines and weighting<\/strong><\/p>\n<p>Instructors should <strong>clearly identify<\/strong> assignment deadlines, assignment weight, term test dates, and the time frame for returning learner work. Deciding on your individual policies surrounding extended and late work is an important step in your syllabus and course design.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignright wp-image-103\" src=\"https:\/\/openstudio.pub\/wp-content\/uploads\/sites\/14\/2023\/07\/extensions-150x142.png\" alt=\"\" width=\"95\" height=\"82\" srcset=\"https:\/\/openstudio.pub\/qualitycourses\/wp-content\/uploads\/sites\/14\/2023\/07\/extensions-65x56.png 65w, https:\/\/openstudio.pub\/qualitycourses\/wp-content\/uploads\/sites\/14\/2023\/07\/extensions.png 165w\" sizes=\"auto, (max-width: 95px) 100vw, 95px\" \/><\/p>\n<p><strong>Extensions<\/strong><\/p>\n<p>There are a number of considerations when developing an extension and late penalty policy. First, institutions and units will have their own guidelines and\/or accepted practices for extensions and late policies, so be sure to check with your home department. With institutional policies in mind, set due dates, deadlines, and late penalties with <strong>flexibility and fairness in mind<\/strong>.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignright wp-image-104\" src=\"https:\/\/openstudio.pub\/wp-content\/uploads\/sites\/14\/2023\/07\/flexible-deadlines-150x142.png\" alt=\"\" width=\"95\" height=\"82\" srcset=\"https:\/\/openstudio.pub\/qualitycourses\/wp-content\/uploads\/sites\/14\/2023\/07\/flexible-deadlines-65x56.png 65w, https:\/\/openstudio.pub\/qualitycourses\/wp-content\/uploads\/sites\/14\/2023\/07\/flexible-deadlines.png 165w\" sizes=\"auto, (max-width: 95px) 100vw, 95px\" \/><\/p>\n<p><strong>Flexible deadlines<\/strong><\/p>\n<p>A learner-centred approach, with built-in flexible deadlines and less punitive late penalties, acknowledges that <strong>not all learners learn and work at the same pace<\/strong>.<\/p>\n<p>Instructors and teaching assistants also have to think about their own workload: multiple extension requests can be overwhelming, and flexible deadlines might be difficult for a teaching team (and for learners!) to manage. <strong>There is no one policy<\/strong> that will work for every course and it is important to <strong>explore various strategies<\/strong> to determine what will work best for your course and teaching team.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignright wp-image-105\" src=\"https:\/\/openstudio.pub\/wp-content\/uploads\/sites\/14\/2023\/07\/late-policies-150x142.png\" alt=\"\" width=\"95\" height=\"82\" srcset=\"https:\/\/openstudio.pub\/qualitycourses\/wp-content\/uploads\/sites\/14\/2023\/07\/late-policies-65x56.png 65w, https:\/\/openstudio.pub\/qualitycourses\/wp-content\/uploads\/sites\/14\/2023\/07\/late-policies.png 165w\" sizes=\"auto, (max-width: 95px) 100vw, 95px\" \/><\/p>\n<p><strong>Late policies\u00a0<\/strong><\/p>\n<p>A clear extension\/late penalty policy appropriate to the course, <strong>communicated to learners<\/strong> on the syllabus and <strong>consistently applied<\/strong>, is strongly recommended.<\/p>\n<h2><a id=\"Strategies-for-setting-due-dates-deadlines-and-late-policies\" href=\"\"><\/a>Strategies for setting due dates, deadlines, and late policies<\/h2>\n<p>There are different approaches to flexible deadlines, depending on class size, assignment type, disciplinary norms, and instructor preference. Below are a few strategies faculty have implemented in their courses\u2014this is by no means an exhaustive or prescriptive list.<\/p>\n<div id=\"h5p-36\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-36\" class=\"h5p-iframe\" data-content-id=\"36\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"Strategies for setting due dates, deadlines, and late policies\"><\/iframe><\/div>\n<\/div>\n<h2><a id=\"Examples-of-how-deadlines-due-dates-and-late-policies-could-work\" href=\"\"><\/a>Examples of how deadlines, due dates, and late policies could work<\/h2>\n<div class=\"essential\">\n<p>Quality Essential<\/p>\n<h3>Example 3: \u201cOops Tokens\u201d to communicate care\/empathy<\/h3>\n<p>\u201cOops tokens\u201d are a \u201cget out of jail free\u201d card for late assignments; you can offer students one or more per course, as described by Darby &amp; Lang (2019):<\/p>\n<blockquote><p>Students turn in a token for a no-questions-asked deadline extension, the opportunity to revise and resubmit an assignment or otherwise make up for an unexpected challenge or honest mistake.<\/p><\/blockquote>\n<p class=\"copyright\">Credit: Nilson, 2015, as cited in Darby &amp; Lang, 2019, pp. 98\u201399.<\/p>\n<\/div>\n<div class=\"essential\">\n<p>Quality Essential<\/p>\n<h3>Example 4: Grace periods for deadlines<\/h3>\n<p>Some instructors provide a permanent grace period for all assessments in the course. For example: \u201cAssignments handed in within 48 hours of the stated deadline will not lose marks. After 48 hours, 10-percent grade deductions will be applied per day.\u201d<\/p>\n<p>Other instructors may frame a similar policy with a more pragmatic reasoning applied. For example: \u201cLate assignments will be accepted without penalty up to the point that I start grading. I have set aside my Thursday afternoons to grade this semester. If you submit after this time, a 10 percent per day\u2013penalty will apply.\u201d<\/p>\n<p class=\"copyright\">Credit: Jenny Stodola, Professional Development and Educational Scholarship, Faculty of Health Sciences, Queen\u2019s University<\/p>\n<\/div>\n<div class=\"advanced\">\n<p>Quality Advanced<\/p>\n<h3>Example 5: Building in an assessment window and using LMS features to minimize administrative work<\/h3>\n<p>Imagine you have a series of short formative quizzes which are completed throughout the course. There are eight quizzes, but in total only account for 10 percent of the grade (low stakes). How could you set yourself up for success and minimize the amount of minding you have to do in relation to this assessment?<\/p>\n<ul>\n<li>To accommodate the class which may be dispersed across time zones, <strong>you set a 24-hour window<\/strong> to complete the quiz.<\/li>\n<li>You create a <strong>bank of questions<\/strong> for which the quiz pulls questions from for each learner, thereby increasing the academic integrity of the assignment.<\/li>\n<li>The quiz is designed to be <strong>automatically graded<\/strong>, or perhaps there is only one question from a set that needs to be manually graded. This reduces the grading workload for you (and the TAs).<\/li>\n<li>Even if the quiz can be entirely automatically graded, instead of releasing the grades to the learner the moment they finish the quiz, you <strong>set the grades to release sometime the following week.<\/strong> This allows you time to sort out any learners who may have legitimate reasons for not being able to complete the quiz during the window (e.g., they may be sick) and still have all grades released at once (i.e., you are not left managing outstanding grades). This also promotes academic integrity as learners who complete the assessment early in the window cannot inform later learners of the correct responses.<\/li>\n<\/ul>\n<p class=\"copyright\">Credit: Jenny Stodola, Professional Development and Educational Scholarship, Faculty of Health Sciences, Queen&#8217;s University<\/p>\n<\/div>\n<div class=\"edii-box\">\n<h2>An EDII perspective on due dates and accommodations<\/h2>\n<p>While deadlines are important to help guide learners in their self-directed learning in an online course, regardless of your late policy, you should explicitly note in your syllabus the <strong>disability and accessibility accommodations statement<\/strong> (or variation of) that your institution has prepared. Prior to beginning their postsecondary education, it is possible that some learners may not have considered that they may need or qualify for an accommodation in the form of adjusted deadlines. Even for learners who already know they will require an accommodation, this offers an equitable way to provide learners with important information and models responsibility for one\u2019s own learning and self-advocacy.<\/p>\n<p>For example, Equity Services at Queen\u2019s University offers the following statement:<\/p>\n<blockquote><p>Queen&#8217;s University is committed to achieving full accessibility for persons with disabilities. Part of this commitment includes arranging academic accommodations for students with disabilities to ensure they have an equitable opportunity to participate in all of their academic activities. If you are a student with a disability and think you may need accommodations, you are strongly encouraged to contact Student Wellness Services (SWS) and register as early as possible. For more information, including important deadlines, please visit the Student Wellness website at <a href=\"https:\/\/www.queensu.ca\/studentwellness\/accessibility-services\" target=\"_blank\" rel=\"noopener\">https:\/\/www.queensu.ca\/studentwellness\/accessibility-services<\/a>.&#8221;<\/p>\n<p>(Accessibility Hub, Queen&#8217;s University, n.d.)<\/p><\/blockquote>\n<p>Instructors at the University of Toronto are encouraged to add the following accessibility statement to their syllabus:<\/p>\n<blockquote><p>Students with diverse learning styles and needs are welcome in this course. In particular, if you have a disability or health consideration that may require accommodations, please feel free to approach me and\/or the Accessibility Services Office as soon as possible. The Accessibility Services staff are available by appointment to assess specific needs, provide referrals and arrange appropriate accommodations. The sooner you let them and me know your needs, the quicker we can assist you in achieving your learning goals in this course.&#8221;<\/p>\n<p>(Centre for Teaching Support &amp; Innovation, University of Toronto, n.d.)<\/p><\/blockquote>\n<\/div>\n<div class=\"note-box\">\n<p><strong>Key take-aways:<\/strong><\/p>\n<ul>\n<li>Enhance critical thinking and reflective practice in your course by providing feedback to your learners that is <strong>actionable, intelligible, timely and ongoing, and meaningful<\/strong>.<\/li>\n<li>Take a <strong>learner-centred<\/strong> approach to setting due dates and deadlines, embracing <strong>flexibility<\/strong> when possible and clearly identifying assignment deadlines, assignment weight, term test dates, and the time frame for returning learner work.<\/li>\n<\/ul>\n<\/div>\n","protected":false},"author":1,"menu_order":5,"template":"","meta":{"pb_show_title":"","pb_short_title":"","pb_subtitle":"","pb_authors":[],"pb_section_license":""},"chapter-type":[],"contributor":[],"license":[],"class_list":["post-108","chapter","type-chapter","status-publish","hentry"],"part":73,"_links":{"self":[{"href":"https:\/\/openstudio.pub\/qualitycourses\/wp-json\/pressbooks\/v2\/chapters\/108","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/openstudio.pub\/qualitycourses\/wp-json\/pressbooks\/v2\/chapters"}],"about":[{"href":"https:\/\/openstudio.pub\/qualitycourses\/wp-json\/wp\/v2\/types\/chapter"}],"author":[{"embeddable":true,"href":"https:\/\/openstudio.pub\/qualitycourses\/wp-json\/wp\/v2\/users\/1"}],"version-history":[{"count":2,"href":"https:\/\/openstudio.pub\/qualitycourses\/wp-json\/pressbooks\/v2\/chapters\/108\/revisions"}],"predecessor-version":[{"id":247,"href":"https:\/\/openstudio.pub\/qualitycourses\/wp-json\/pressbooks\/v2\/chapters\/108\/revisions\/247"}],"part":[{"href":"https:\/\/openstudio.pub\/qualitycourses\/wp-json\/pressbooks\/v2\/parts\/73"}],"metadata":[{"href":"https:\/\/openstudio.pub\/qualitycourses\/wp-json\/pressbooks\/v2\/chapters\/108\/metadata\/"}],"wp:attachment":[{"href":"https:\/\/openstudio.pub\/qualitycourses\/wp-json\/wp\/v2\/media?parent=108"}],"wp:term":[{"taxonomy":"chapter-type","embeddable":true,"href":"https:\/\/openstudio.pub\/qualitycourses\/wp-json\/pressbooks\/v2\/chapter-type?post=108"},{"taxonomy":"contributor","embeddable":true,"href":"https:\/\/openstudio.pub\/qualitycourses\/wp-json\/wp\/v2\/contributor?post=108"},{"taxonomy":"license","embeddable":true,"href":"https:\/\/openstudio.pub\/qualitycourses\/wp-json\/wp\/v2\/license?post=108"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}