Outcome-based Assessment in Further Education

There we go. People filter in already. Thanks for being popular. Just gonna give it a few more minutes everybody before we jump off. Just give her a great chance that to come and take some of that incredible knowledge, Andrea, is about to, dispose on all of us. So just wait a few more minutes.

So I think now is probably as good a time as ever to kick off for today's session. Everybody who joined us last time as well, thank you for coming, today. There will be another session next week, which will be the last for this series where there will be more in the future. Don't you worry? Today, we're going to be looking at outcomes based assessment and further education. With me, I have Andre Silva, one of our solutions engineers, yes, we do have the same style as you can see by lovely color coordinated dress today.

We're gonna go through this. We're gonna go we've got a few pause whenever we need to answer a little bit later on as we go through this, just to get sort of an idea of where everybody's at, what systems and how you guys are using and how you might be doing this, internally. Andre, if we just move to the next slide like I said, you can see very much we have the same style there. They have been what the clothes have been washed in the meantime. Don't you worry.

It's not the same clothes as everyday on picture day. I'm Joe Stafford. I'm the senior account executive for instructor for the FE market. That's why I'm in all of these sessions and, you'll be seeing a lot more of me and you recently entered the FE space with instructure. Been done for a while.

And Andre, Andre himself has had a lot of experience in the FE used to work for QA limited, in their apprenticeship track there. So lots of experience here. That's why I had a little bit of a head start when he moved to instructure on what cameras looked look like and how to use it for these things. As ever today, if there are any questions, there is a chat you can leave everything in. There was also a q and a feel free to put any questions in there as well.

If they're easily answerable, I will, I will, answer them for you. If they're harder, we might leave a bit of a blank space there for Andre to get to at the end of today. So a quick overview of Instructure very briefly for any new faces here today. Instructor is one of the global is the global leading Veely provider in in the world with over six thousand customers in in seventy countries, almost five of those countries in the UK and I itself or five countries actually in the UK and I. We have over thirty million active users, on the Instructure Lane platform and we see a lot of them coming back using our Canvas community to share ideas and actually this is where we've grabbed a lot of those ideas for this webinar series, from.

We also have, one and a half million members in the online community every single month. So we see a lot of people sharing ideas there working together. I'm not gonna bore you with too many statistics of of institutions, but we do have a lot in the UK and I. In the FV even in the FV sector, maybe in Grimsby Institute, where which we have some interesting use cases from, and another one, City in Glasgow as well, which we'll happily share any information about later, but some good, noteworthy names there for you guys. If you do know, then reach out to them and see what thoughts on how they've actually been using outcomes in their assessments as well.

There is also a native mobile app, which works very seamlessly along with this. Instruction, it is all available in thirty three languages, including Walsh, and then the, obligatory mention of our uptime there as well, which was always very helpful for the system. Now, a lot of things we're going to show you today, is core canvas. There are one or two pieces are additional features. That is because we have a very rich ecosystems partners.

One on there you'll see Badger is actually one that we've recently acquired. Well, I say recently, it's probably close to a year now. But that's some additional feature and functionality that now sit within Cams, which will be highlighted today as well. And then also some other partners on there, you'll see such as Microsoft and Zoom, you know, this is a rich ecosystem. A lot of this can help with the outcome base specifically when we're looking at, so the different tiers and different outcomes we're looking to achieve and any apprenticeship tracks that are being followed, you know, each institution, each department, each course does need its own tools and making sure that they're all integrated into one area to make consolidated and consistent learning profile for wide students is very important.

Now, before I hand it over to Andre, who will enchant you with the demo presentation he's actually presented for today. We actually have a few questions for everybody here. So the first question and there will be a poll for everybody to answer and we will share the answers is very quickly. Are you delivering outcome based learning or training. Perfect.

I think we're almost there. Almost everybody has answered. What we're seeing primarily is sixty percent if we share the results sixty percent have answered yes, two have said not yet, but I'd like to. So hopefully we can share lots of insights today. Those who have said no, for free to leave in the chat or any reasoning wind, maybe we can dive into a bit of discussion with enough time at the end, to cover that off.

But hopefully there's a lot of knowledge we can share today, around that. Now our second question is, how do you assess learners and capture evidence? We have a few different answers there, mainly the first one being assignments file. Files submissions, example, Doc PPT PDF, and the likes of that, the second main assignments, video submissions, the further quizzes, and, the fourth being other, please specify. When we say please specify again, please do that in the chat because the poll doesn't allow you to comment there. So what we're seeing here again is little bit of a split, but most people using, assignments, file submissions, such as Docs, PPT, pdfs, The next being assignments, video submissions with two verbs, and the final being quizzes.

It looks like nobody is using anything else besides those those formats. Which is nice to see. So, we can end that poll and move to the next one. Maybe give a quick share of the results. So you can see that for your own eyes.

And then we'll slowly move to the final question so we give Andrea enough time for this presentation is are you leveraging Michael credentials to align qualifications and learning outcomes with employment market trends. Again, yes, not yet, but I'd like to, no. We're seeing mainly not yet, but I'd like to. One no nobody currently leveraging them which is interesting. I've got to see one yes.

Cipher. Perfect. I think to give Andre enough time to present everything and show everything, so interesting results there. We're seeing lots of people using outcome based assessments if you're wanting to, the different file types that are being used much more around the assignments with the file submissions, and then actually not much credentials used, but a lot of people wanting to use credentials to align learning outcomes with. So, we'll shape off all of you guys thinking.

We'll put all the thinking caps onto Andre's head. And, Andre, over to you for the for the for the proper demonstrations. Thank you so much. It's a pleasure to be here today. So today, what what you we we are going to be covering a number of aspects such as auto map a qualification into Canvas, auto capture, learn progress, and we are gonna be using the map qualifications in order to track that that progress.

How to monitor, learn a progress using reports, there's another way of of doing that besides reports that we are gonna cover as well, formalizing, vocational skills. And then finally, I'll to bring everything together into portfolio. The objective of today's session is to fold. First of a first of first of all, I'd like to give you, some workable or immediately actionable workflows that you can, if you already have Canvas, can start thinking about your structure, how to structure your programs, and start tracking, and capturing evidence using outcomes, if you're IVF Canvas. And At the same time, if you don't, I mean, if you don't have, some of the tools that we are gonna cover today, give you some ideas in terms of future thinking and things that you can do in the next steps in terms of, your solutions, future solutions.

So I'll jump from here to, the, the demo, and I'm gonna start with, the dashboard. In this case, in this in this demo today, I'm not gonna be going into too much detail of to create courses, how to create content, we'll only focus on outcomes, and we'll only four focus, on how to capture these evidence using assignments. So what you see here is the this Canvas dashboard. You probably already comfortable with this. And what you have is each one of these styles are typically called courses in Canvas.

Before we actually go and start exploring how to create outcomes and and and track outcomes, some, I would like just to explore some naming conventions, so they can streamline what we mean by some things and try to align now, phonemic conversations with yours. Typically, gather schools each one of these unit's courses. And if you have short courses, you are delivering short courses. It may make sense to keep on calling these courses. But for the sake of further education, especially longer programs, where you as part of a program, you may have a number of units.

It may more may make more sense for you to call these units or modules. So for the sake of this demo today, I'm gonna be calling this unit or module and not courses. However, the way you would use capture outcomes in progress, against those outcomes would be the same regardless of whether you use the course or a units or module. So The first thing, if even before starting to think about content, we have a qualification, isn't it? And what I'm gonna show you today is how how to start thinking about that qualification and bringing that qualification into the system. And then start thinking about assignments and assessments around that qualification, and only then we start thinking about the content and building content around, the assessment and the qualification.

So the first thing you want to do, when you start thinking about bringing the qualification in is you'll go to your administration area. You need to have administration, access to to do this, and you click on outcomes. The reason why it's important to create outcomes at the at at the root level, and, therefore, using the administrative access is what we can do is bring all the qualifications that are being offered delivered by your institution one place, a top level view. So from one page, I can see all the qualifications I'm delivering. In this case, can show you, for example, an apprenticeship program where I've organized, the qualification into duty areas and inside each one of the duty areas, you're gonna have the knowledge skills and behaviors that the learners will be developing.

However, today, with the one I'm gonna be covering is, agency, So as the national certificates in engineering, for the this example is from Pearson. And what we have here is is not that I they aren't units missing is just that you can choose specific units to to bring this qualification together, and these are the the specific units chosen by this hypothetical, institution. And what you'll see is, I've organized not only the specifications or, the outcomes per qualification, but inside each qualification, you can have a number of folders and organize the the outcomes into each folder of a specific unit. So what you see each unit will have a number of outcomes. So qualification unit, and then the outcomes inside each one of these, folders or separators.

And the important thing here is you don't need to do this manually. You can import all of these information using a CSV file. Just click on import. Of course, you need to follow a particular format. And once you have imported into the system, they will be available to you to start using in through your learning flows.

I would just very quickly show you what the learning outcome looks like because this is quite important. You we allow you not only to give a name, the name of the the the outcome, you can also give friendly names or friendly descriptions And this is super important when sometimes the language used in qualification or standards is not very accessible and you may want to make it more available to learners and more accessible to learners. And down here, you have the, what we call, proficiency rating, which means what are the marks that you are gonna be giving to learner in this case, I've I've given a number of points, and you can define, exactly what's gonna be the mastery, which means the pass are great, for the specific, for each specific outcome. You have a calculation method. In this case, if I use if I assess this outcome many times, I'll just say higher score, And but you have a number of other ways that you can, measure, learners meeting these these outcomes.

Why are outcomes so important? Outcomes are the best way to track learners progress against the qualification across multiple courses of multiple units. And the way you do it is once you have added the outcomes onto these root accounts, then you cascade it down to, the subaccount level. So, for example, what I've done here is I have a number of subaccounts for the education, and I have level four diploma, which is the one I'm work working on. And what I'll do to do to to ensure that these these outcomes are be brought to the, subaccount level is, we'll, find outcomes, identify. So, in this case, my account, I'll go specific to the outcomes at once.

I select the qualification. In this case, it's the whole qualification I want to bring in, and I'll just click on add all outcomes. Because I've already done this, I cannot import them again, but just just wanted to show you what's the workflow. So you create the outcomes at the root level, bring them to the subaccount level, because you need that later to take, we'll we'll we'll collect, reports. So whatever the level you are collecting reports at, you need to cascade those outcomes down.

To that level, and then you bring the outcomes to the course. And that's what I'm gonna be doing now. Right. So we are back to the dashboard. And I'm gonna jump on to a unit.

And this guy is the last unit of of this program. It'll see there is this homepage is is is is is is the Microsoft SharePoint. We probably covered this in a different session on how to integrate really create this reach into interwessions with Microsoft teams. But what I wanted to show you today is now you need to bring the outcomes that you have created, and you have mapped across against the system to root level. And what we will do is ensure that they are in these specific units.

And the way you do it is again the same. You find you can either import using a CSV file, but if you import it as level, the outcomes are gonna be created at the course level. And what you really want is to import outcomes from the root level. So you you do do the same thing, go to, in this case, my sandbox, go to, in your in your case, it's gonna be your account name, you go to deliver four, the qualification. And in this case, because I'm on unit seventy three, I will import the outcomes from the unit seventy three directly to to this course.

At this point, I will have brought down from the root account to the course level or module level all the outcomes I want to develop as part of this course. So now we start thinking about assessments or assignments. And there are a few things I wanted to cover here. So first thing when you start thinking about assignment, you need to think what is gonna be formative assignment, what is gonna be summative assignment, and then you can start if you start organizing it in is really easier later, whenever I create new, items add them onto the right placements. But what allows you to do as well is provide a weight to a specific group.

So you just need to go there, and you can assign, group groups white. In this case, in this case, what I've done is seventy percent for my summative assessment, collection of evidence, and then thirty percent for the final exam. But you could adopt your your own approach. What and I'm really interested or or I found interesting the the the feedback or the the the the the the the the voting that we have done before. So you you you think the same way or you have a similar approach, which is quizzes are typically used for more formative assessment And then you have submissions, and you have a number of of of different types of submissions here that will cover that later when we we go and start marking those.

So, yeah, quizzes as formative and then summative assessment with submission of artifacts. Now, Once you have created quizzes and once you have created submissions, what you need now to do is to link the outcomes that you have brought down from the root level and from the qualification to one of the, assignments. In this case, because these are formative assignments, I have not added, outcome but if you wanted to add outcomes to a quiz, the way you do it is click on plus Rubik, and what all you need to do is find an outcome. And again, you are always bringing those outcomes down to that specific assessment that you want. In this case, I'll, for example, bring learning outcome one, import, and what I've done just now is imported the outcome one against this specific, quiz.

I'm not gonna do that now. Actually, what I'm gonna show you that you cannot only do that to the quiz. So if if I if you do what I was doing, you're bringing an outcome to a specific, quiz, but you can actually go to the detail and actually link an outcome to a particular question. And the way you do that is in the new quizzes in this case, I will go to, this question, and I want to add an outcome. I select that I want to add an an outcome for my learning outcomes, click on the outcome I want to add in, and that's it.

I've linked an outcome to a particular question in this quiz. So super simple. You just you can do, as I was saying, link a outcome to a quiz, when the lender completes the quiz, they get their outcome completed or to a question, or in a specific submission. Let's see this submission here. You know, there are several types of submissions.

You can submit online documentation. You can specific be very specific what's the type of file that you want to manage to submit. Not gonna cover that, in in great detail, but I just wanted to show you that it works exactly the same way you would have a button plus Rubik, and then you add the learning out comes to your assignment. Note that here, I've not only added an outcome, but I also added criteria And I had the past marital distinction. And notice here, I've not given any any any points because the approach here is I'm allowing, the teachers or the markers or the skills coaches to mark a work against specific criteria.

And then only at the end, decide which is the rating that I'm gonna give on that specific outcome to the learner. So imagine letter passed, so there's evidence for pass. I don't have evidence for merits or distinction, then it's just a pass, and I'll select that again. We'll we'll we'll cover that in a second. But what's just this idea that outcomes will need to be enveloped into or added into a, Rubik in order to be linked to an assignment.

And then you can add additional criteria, which is gonna be fine tuning that specific, outcome. Hopefully, that makes sense, Please let drop any questions if you if you have any, and I'll cover those, later. Okay. Fantastic. So what you have done now is we have created outcomes at the root level.

We have brought the outcomes to the account and course level. So all the outcomes to the account level, which is program. And then for each one of the units, only the outcomes that are relevant for each one of the units. We have now integrated the outcomes into the assignment that is gonna be measuring and tracking Linux progress. So what I'm gonna show you now is how to build this into a learning flow.

Just one one thing before I go there, I just to be sure that my outcomes, the outcomes I have brought to this course are all being covered. You come to outcomes again. Remember we have been here before, we brought the outcomes down here in this section. Remember, we click there and find the outcomes. What I'm gonna do is because now I've linked these outcomes that I've brought down, to specific assignments, I want to ensure that all the four outcomes are being covered.

And I can this gives me the confidence that All I need to collect evidence for has been has been linked to an outcome or each one of the learning outcomes is linked to an assignment. And I can actually come here and see learning outcome one and where are those outcomes being covered? What's the the the submission that is gonna be covering those outcomes So this just gives a an overview of what's how to link top level with what happens really in the module. So what I'm gonna show you now very quickly is, how I can, link these assessments into a learning flow. So you are probably already comfortable with how Canvas organize this content using modules. So I'm not gonna go into too much detail.

I just wanted to give you a sense of the workflow or learning flow from a learner perspective. So I've created the first module, and again, Canvas organize organize this content into what we call modules. For you, if you are calling a course module, this is a topic, or some people call it folder. So, I've created a I went introduction topic. Then you have a topic one where I've covered knowledge, knowledge fundamentals.

And what I'm doing here is offsetting the teaching from the classroom to happen online. So the content is online, and we have created reach, examples. I'm not gonna go into that in too much detail. We'll have sessions later where can cover that in a bit more detail. But, what I wanted to show you is you have an introductory knowledge for the mentals, which is followed up by the formative assessment that we just saw earlier, which is the the quiz.

I'm using quizzes for formative assessment. And then finally, we have a live event for topic one. So what we have is a cycle where learners are learning and then that we are ensuring that they are ready for a live event. And when when they jump onto the live events, they actually are taking, benefit from that session. And actually, for example, use, work on on scenarios where it can apply the skills that they have just learned, in a, in a, in an active way.

So offsetting things that are repeated. So we don't want trainers and teachers to be there just to repeat knowledge, the knowledge dispensers, moving that knowledge online so that they can Lendes can complete those at their or that that knowledge that create that foundation at the on the in their own time, at their own pace, and then use those those live events really to be getting down to actually applying those skills in a safe environment. So we have, in this case, again, this is just a fictitious, flow. In this case, is gonna be a number of topics, and the flow is very similar. Knowledge from the mentors, check that lenders are ready to the live event, join the live event to pry the pres the the principles of the knowledge in a safe environment.

And then finally, once they have gone to a number of iterations around knowledge and a practical application, then we are allowing them to go into the workplace and do replacements. Again, this is just a fictitious example. You can just can apply some IDs if you want. You can test some of these ideas that we are showing here today. I just wanted to give you a sense of a flow and now the assessment links in with everything else.

Right. So here we are. This is the part where learners are gonna apply the skills and generate the evidence. And two things I wanted to to say before we go on to marking. Think about assessment as being a multistage, a multistage process.

So I've created a work a workplace application Q and A section where learners can dialogue and have conversations with each other and with trainers where they can ask questions and they can share what they are doing in the workplace. And then I've broken down each learning outcome into submission. So submission number one covers learning outcome one, submission number two, learning outcome two. Some some institutions, right, to bring all of these outcomes into one submission. Quite difficult to to measure.

So what we have done here is just probably good practice to get one submission so that the learners can focus on that particular outcome generate the evidence, submit the evidence, and you can mark that evidence and and and get that completed and verified. So Lenners will complete. Again, not a point in time. It's gonna be a process, and we'll we'll see that as we start going into marking, but this is the idea is they've submit evidence for each one of the learning outcomes. And once you have done that, they can then have a final exam, if that's the case within your institution.

Okay? So Now we have brought the outcomes not only into the assessment, but we have integrated, really integrated assessment while in this learning flow. And we have cohesive for learning, compelling learning experience. And she's completely blended learning, right, online, and you have live events, which are in the classroom or in a in the training center, and then in the workplace and application of knowledge. Right. So now that we have everything working, let's see how we can capture this evidence, and they we can start processing these evidence.

They'll not as have submitted. And I'm gonna show you three examples. First example is out to track or capture evidence using video, and this is gonna be using one of our tools called Studio, Canvas Studio. Then I'm gonna show you how to capture evidence from, written documents, written essay, and some some differences between video and video, an essay. And then what I'll show you is a OneDrive cloud submission, just so that you can see, how that how that works.

Right. Starting with video. And typically, I'll leave this one for last because it's really impactful, but it makes more sense in this in this in this flow. So Studio allows not only, gives the the institution tools not only to create content. So you can use Studio to create your content and give your trainers, the opportunity to create content, record record video, record them, and then create quizzes around that.

So it creates quite, reach multimedia materials, multimedia, components. But what we are focusing today is assessment. So I'm gonna show you the assessment part of of studio However, there's much more than just this. And what I wanted to show you, which studio is, this idea that Linux can submit video video stops being just a file that they'll send back and forth, between, themselves and, their tutor or their employer, is something that they submit into the system gets integrated in this way that I'm just showing you here. And then the markers, teachers, trainers, or skills coaches can actually watch the video, And as they watch the video, they can drop comments.

And you can see that in this timeline, you have a number of dots. Right? Each dot that you can see here is a comment that has been left. So it's a comment with the time code. And what we are saying here is as you watch and you mark the video, video becomes a living thing, an organic thing, and not only you are asking questions about the video, but you are allowing the learner to expand what they actually meant by particular aspects in the video. So this idea again, assessment, not a high stakes moment, appointing time, but there's a process.

You are allowing the learner to expand their knowledge rather the learner to submit multiple times if necessary or not, they may submit once, but then, expand their their their what what they actually meant by each one of the submissions. And here you have a discussion between a a a marker, me, myself, and, a learner. However, this can be quite much more advanced than this, you can have multiple markers or marker in a skill coach and groups. You can also have group submissions where you can have actually have very rich discussions attached to a video. Right? So once that has been once you left left comments, now because we have integrated the outcomes into these assignments, you have the outcomes here, and you have the, the, the criteria.

So what you can do is very easily use that to, mark the learners against each one of these this criteria. So I think this gives you a sense of Yes. It may be you need to create a, an Excel or a CSV file with all your outcomes and outcomes for your qualifications and add them on the root level and then cascade them down. That's a bit of work, but the amount of work that you save over time by doing what I'm just described is is is enormous. And, yeah, not just that.

Not not only you are simplifying the process after that upfront investment, you're actually ensuring that your process as as as as as a as a focus on quality. All all the decisions that are made and old, for example, all the marks that are given are against specific criteria. So, for example, in this case, said that this line has passed. As as passed as, has met the criteria for merit and has met the criteria for distinction, and therefore the get distinction And then I save that that marking, and now it immediately gives me the distinction grades. So mathematically, by using this the scheme that we have created, the outcomes plus, the criteria, we can automatically mark work, which is really, really simplifies really simplifies the process.

Okay. So this is video. What I'll what I'll do now is I'll close this one down go back to the home page, and now I'm gonna show you what the essay looks like. And it's very similar. In this case, this learner estimated a number of of, made a number of submissions.

You could have done the same with video. I just wanted to give you the sense that with video, you can submit once because video is quite complicated to export create again another version and upload it. So with video, typically, you're gonna have a big submission and then work or discussion underneath. In this case, you can have you can ask the learners to, work on a specific document, and you can have multiple submissions. So you can see that this learner is actually a good learner.

They have had merit, or in graded merit, but they are looking for, distinction. So you can go back in time, and you can see what has been discussed over time, again, this quality focus, everything that has been discussed, all the marks against a system that is clear, transparent, not only for the markers, but also for the learners. So you can see what has happened in the past, and I can very quickly jump to the present, latest submission, and I can see what the learner, as, that the new submission, the learner has made, and I can very quickly just changed my my my score. And I said there was no evidence for distinction. And now I can say that there is evidence for distinction and therefore the get distinction in this outcome.

Okay? Just going back to what I just mentioned before, now you understand why zero zero zero. What we are using is just how much does a tool to measure where there is evidence or not for each one of the criteria that the lenders need to hit, and then give a final grade using the outcomes because remember, the outcomes is what attracts the learner across. Hopefully, that makes sense. Okay. So I'm gonna exit now.

Of course, just before I go, it can also leave comments. You don't need only to to to to mark using outcomes. You can leave comments directly in the documents, like I was just showing you now, or overall comments I want call learners to see you on a particular submission, and I can use this, this, this area here. Alright? So going to go. Now I'm gonna go to the grade book.

And all the grades that you have been giving to these to these pieces of submissions or some submissions that planners have made will be recorded in the Gradebook that you can see here. In that case, the green one here, means that the line has resubmitted, the submission that we're just looking at. I've not marked, so that it's saying you still need to mark this one. Green meaning you are a this learner already at the grade, but, yes, I'm guessing it again because they want to improve their their work. The final one that I wanted to show you, final type of submission I wanted to show you is the cloud cloud submission, or cloud assignments using OneDrive.

This is fairly fairly new because this one drive implementation. And the idea is you share a document with a learner, an online document with the learner, word document here. And you this is a template. You asked the learner to submit this template. These are the things I want you to cover.

And what I have is the learner side where the learner, Lucas, in this case, they can see the assignments, and they can see what's required, they can see the templates, and they can see the learning outcomes down here. They know what what they are gonna be, graded or marked against. And in this case, this line has already started filling that or completing that template, and they can just click on on the document to open it, and they can edit the documents, in the cloud directly. And then once they are done, done with that, they can then submit the document, submit the assignment. Okay? So just wanted to show you these different types or different approaches, in terms of, capturing evidence, video, text, with text submissions or, document essays, or if you want to have a cloud submission, you can also do it.

There are a number of other files, and it can be very specific on the files, but I I thought giving you just these types, would be, sufficient for today. Right. So what we have done now is we have created the outcomes. We have linked the outcomes with assignments. We have brought assignments into learning experience.

Now we have marked the learners and mark the those, the those submissions. So at this point, the learners will have, met some of the outcomes. So there are two ways now that we can verify that lenders are meeting these outcomes. One is micro, so module unit level, and the other one is macro, which is across multiple courses, and I'll show you both. Okay.

So, the let me jump to, to teacher site. So I'm going back to the teacher, going back to grades. And before we are looking at the submissions and notice that we are now at filters. Is it is it this is an update that we've just recently made. I love it because you can If you have created assignment groups, remember, we talked about these assignment groups before, you can, jump between assignment groups.

In this case, formative assignment, I can I have a glance, a deformative assignment, a glance over the summative assignment, work placement, workplace placement? And I can have a a look at the exam results as well. So really simple to actually be really focused. Sometimes having a long, great book gets quite confusing, quite difficult to follow, but with these filters, you may really simplify the process. However, what I really wanted you to look at is the learning mastery grade book. Because this is what allows us to look at outcomes and just ignore everything else Just look at the outcomes that we have brought to this unit and see how our learners faring against those outcomes.

And this is on the unit itself. So we're not at the top level. So I can very quickly see who are the learners that are struggling, for example. And I can see, okay, Mia is having some difficulties, and I can see which learners are, for example, getting distinction in there for performing better than than than expected. And you can see that in this case, this is quite a good group, but he allows you to very quickly see if you have a per dive level, if you, on our bird's eye view over these specific units and how this specific cohort, is performing.

Okay? Right. So this is the unit level. Now we are gonna show you how to capture this progress on a unit level. So, we'll go to we have been here before. Let me just learn outcomes.

So we're back to the administration background, or by administration section. And what I'll do is I will go to subaccounts. And I'm already inside further education. I'm already in the level four diploma for engineering. So what I can do now is get a report on the outcomes for that specific program, which is some account program.

So I'll go to reports, And you'll see that you have outcome results here. And in this case, I've already I've already requested so you can say old terms for old users. And you can run the report. In this case, I've already run, ran my report before. And you can get a CSV file that has all the information you need.

In this case, you have the lender's name. You have the lending outcome right here. So and you see that you have lending outcomes for all the units of that specific of that specific account. And you have on the right hand side here the rating that Lennis have received. Okay.

So a document data. Sorry. We are starting to talk about data. The system is tracking these in the background, and you can at any point get the information for a particular learner for a particular outcome, or for a particular rating, see which learners are reaching reaching its little these rating at across multiple modules or units. Okay.

I'm gonna cover close this one down. Next, I'm gonna show you one that is a bit more visual. A way of capturing these outcomes, which is a bit more visual. You come to people, and you select you look for the person you want. For example, imagine this is a skills coach and he's trying to find the progress of a learner on a particular, program.

So let's look for Warren. Yeah. Warren is not on the subaccount. So I'll go to open us to my account. Level.

So war run. And let's use war on Griffin. And I can see the outcome results for WerenGriff and by clicking there, I always expand to see all the artifacts and what you have in this view is for this particular moment, for this particular person, for this particular learner, you have all the outcomes that the learner has been allocated to. And whether they are met the criteria, they have met the outcome, or, or not. And how many attempts they've they've they've they've done against that specific outcome and whether there's an artifact or no, or or more.

So you can see one attempt from one artifact and these line has got as received five out of five on that particular outcome. So if you have a learner in a program, subaccount, and if that same account has multiple units, with outcomes. As soon as the learner is enrolled in that unit or module, they will automatically be linked to these outcomes. In those outcomes, we'll automatically show on their pro profile. So, Joe, I I I think this closes this first cycle, I are now gonna jump on to the next stage, which is how do we use credentials and how do we track progress on credentials Any burning questions that we may may have? Let me know, and I'll I'll be happy to transfer a couple of them.

I think you've stung most of them into silence. I think there's a few people if the webinar will be available later so they can come back and reference it because I think you've been showing them some really interesting stuff. And yes, is the answer to that. You will be able to your house on the webinar to go back and reference anything. I I know there was a question about, somebody who was struggling with some of the CSV uploads for people, anybody with questions after this or wants to have an in-depth session with me and Andre, my email is in the chat.

Feel free to grab that. Send any questions in issues over to us, and we'll happily set up some time to go through it with you, at a later date in the near future. But yeah, otherwise no address, in them into silence, I would say. Hopefully, that's a good thing. So in terms of, outcomes in uploading CSV files, we provide a a template that you just to replace with whichever clarifications and outcomes you have and explains exactly how to create the multiple levels and even the, the grades available or the the ratings that you want for each one of the outcomes.

And you can set that automatically Well, you need to create the CSV file. And once you import, it creates the whole structure in the system. It's not it's it's some work to set set it up first But once once once you have a first version of the CSV file, making changes is really quickly, really quick. Then you actually once you have created the CSV file and you went to make changes later, making changes is really easy because then once you upload the file, it just updates the or or each one of the outcomes. Another thing is just to to to be clear on what's happening in the background.

When whenever you create a learning outcome, And especially if you're going to quit that's why you should create the learning outcome at root level. Each learning outcome will have a unique identifier. So what we are doing, an ID And so what we are doing is pinning that learning outcome to the root and then cascading it down, but what we are doing really is saying that ID, learning outcome with that ID leaves not only at the root level, but then specifically where and then you you establish exactly subaccounts or a courses where that ID is gonna be linked to going forward. Okay. So we have done a most of the the the journey here.

We now have all the evidence, and we are capturing evidence. And we which we we've shown or or covered how to look at progress in two ways. And we used reports, and we used the outcomes page for each learner. For for for for each learner profile. So what I'll do now is jump on to credentials because credentials allows you to do to link badges or credentials to specific outcomes.

And that's really useful. Not only because you can create visual learning flows, but also you can link those abstract outcomes from a qualification, to specific, market skills that are needed, and you can see how the skills are in demand or not. So, basically, what we're doing is going from the very app which is a qualification for something really tangible with value in the market. So that's what I'm gonna show you now. So what is Canvas credentials.

So Canvas credentials is, I I call it, technological infrastructure. What we are offering you here is a portal making you, an issuer, an institution that is an issuer on a network. This is using the standard called Open Standards two point o. And what it does is is a network that is accessible by, people from excite from outside the the network, you are an issue where you you generate these tokens, these badges, these credentials, and you allow you link those b those credentials to anyone that the that has completed a particular course example, or as particular, complete a specific outcome. And what you are doing is as you wish you these two learners as they complete specific parts of their learning journey, they can be verified by employers or by prospective employers.

So Once you issue tokens or credentials, they are visible from someone that is not even using the system, but they can verify that those items that have been issued or those credentials have been issued by you, that they've that they mean that the line has completed a particular pathway, and they can very quickly verify whether the learner as the credentials or not. So what I'll show you is, what it looks like in terms of being an issue, create creating a a few, badges or credentials, and then link linking them into the system. And because we have been, working on unit seventeen three, what I've done is I've created a batch or credential for the unit meaning when you complete the unit, you'll get this credential, but I also created credentials or badges for each one of the learning outcomes. And the idea here is the more, specific you are, the better you can link it to with specific outcome. So for example, I'm gonna show you learning outcome number four, I can specify I'm gonna show you what it looks like when you add it one of these badges.

I can say exactly what's the description of this badge, what the learner will know in order to have earned this badge. And then, of course, you can change the image. You can change the identifier. We have a designer for badges. You can define exactly what the achievement is, in this case, it's assessment because I'm doing a learning outcome.

And I can link that outcome, learning outcome from the qualification now to an outcome skill that is relevant in the market. And what I can like, in that case, I'll I'll link that skill with Polymere Engineering, and you can see how that skill is fairing in the job market over time. And there you there you go. We have completed the whole cycle. From qualification, abstract, not very tangible, linked into the system, linked into things that lenders are actually doing or submitting work against, they know that they are learning a specific knowledge from the mental, focusing on that specific skill, and then linking the skill with tangible value in the end.

So I'm gonna jump now to Canvas, now that we have created the number of badges, I'm gonna show you how are you linked that into the into the course, into the unit it. So in this case, I'm gonna go to the dash dashboards once again. So you're comfortable with this dashboard now. This is my program. I've completed all the unit.

I'm going to unit seven, seventy one in this case. I'm going to click on credentials that you can see there. So click to our credentials. And because I'm a teacher slash administrator, but in this case, you just need to be a teacher, I can start linking badges that I've created the other on the on the other, window that I was just showing you, I can link badges to specific parts or specific components of learning flow. So this, this, this, this board shows you exactly what I'm what I'm what I mean.

So I'm giving them a credential for having completed this unit. And I say when they complete the course, they will get this badge automatically, but I have added as well learning outcome badges or credentials. So every time they complete the learning outcome, they'll complete a part of that specific journey. And that's really useful because now what we have done is for each one of these outcomes, you have linked to market skill, and learners can measure the value of what they are learning at any template pointing time. And then it can be really fancy.

You can, for example, in modules we have created on the welcome and introduction section, start here And what we have done is we have built a pathway using all the credentials of specific program, unit one, two, three, four, five, in this case, eight, nine, nineteen, and seventy three. And to complete this qualification, those are the units that they have to complete. In this case, they have already completed all of them apart from the unit seventy three. And in this case, I just wanted to show you how they left. They'll get the bag when they complete this course, but before they do that, the discourse unit module.

But before they do that, they need to complete or meet the outcomes the learning outcomes, which they will complete every time they close one of the submissions and assessment assessment cycle. So we'll complete submission number one or assignment number one, they submit the left discussion with their marker until that outcome has been met. Once the the outcome has been met, this batch learning outcome, one, two, three will be automatically issued to the learner. So really powerful, you can not only, give, specific badges for a completion of a program, but you can actually be very specific and actually link badges with outcomes, bringing that level of tangibility. So to finalize so now we have a bunch of submissions and evidence, and we have a number of credentials badges.

So what I want now is to bring them all together. Well, Len isn't going to bring them all together. So what I'm gonna show you is the folio. And folio is I have just need to click there. Voluis are our our tool, Canvas tool to allow Lenice, a portfolio tool, e portfolio tool that allows Lenice to bring all of these evidence together.

So Pollio is available for free and for live for Lenders. Lenders don't need to ever leave it behind so they can use these as their as their as their, CV a library or way of creating the CVV and exporting the ACV, curriculum document as well. So they could they'll be able to add their introduction, work experience, education, and all the courses that they have completed in Canvas, and all the work that they have completed in Canvas, they can be automatically imported. So that work has been marked by their marker or their skills coach, and they there's an integration, and they just need to press a button, and that work gets integrated into their, portfolio. And the same goes for badges.

So both the work that gets signed off can be integrated in that portfolio, as well as badges that they have been acquiring over time. Of course, they can also upload their own work and if they want to upload their own documentation, they can. And even after they have left your institution, and they are learning on different institution, they can still use this portfolio to con in compliment it over time. And set so can they, badges that they acquire of, over time? So, let me show you just before I finish, going to I'm going back to the learner, and you'll see that as the learner progresses throughout their, lifelong learning journey, they will have access to this backpack. This backpack is gonna be staying with them.

And what I wanted to show you is learners, we will be able to collect, collect all the badges that they have been acquiring not only from your institution, but from other institutions that are using open standards two point o as well and collect collect them. So in this case, certificates that, or badges or credentials that I've acquired via certifications, I can collect them and organize a collection. Or folder where I can bring them all together. Personal development. Of course, they have complete any music.

They are it's my course, personal and then professional development that I've done, for example, with a company that started working with, and then you can share either individual badges with employers, or you can make them public. So at the end of your experience, learners will have their portfolio that they can take with them, and they can take have this backpack with all the badges that they acquired with your institution. Take that with them and use this backpack to accumulate badges that they may collect, in the future from modern institutions. So this closes the cycle, Joe, again, over to you, if you have any questions, anything I need to address for we sign off. Let me know.

So far no questions. Sally hasn't watched and precise one from Sally who has asked how are our layouts so different from theirs? I think there's a styling choices possibly. Sally like with sort of your other questions before happy to go through this. I know Graham last week also said he'd shared the courses afterwards. So that's just something you could very easy copy over.

There's a few different integrations in here with, Microsoft sort of on the screen right now. But depending on what into what layouts that you're talking about happily discuss that with you in a in a call. We can actually go through that. Maybe even share some of it through comments so you can actually implement it yourself. Andrea, I don't think you covered any because one of the questions I was saying was are you using Studio for this studio isn't particularly involved in any of this.

It is a video platform. There's a bay, maybe a small part, but the layout structure, even like you see it here, because I know somebody else also, I think it was Megan commented on she likes how you've listed it up here. Definitely something we can look into with everybody and show what that looks like. This is the only studio apart, but you can embed different medias in here. YouTube has a free integration as well.

You can use to embed like this. Just a few different features you probably won't have with YouTube but lots of different things we can dive into in separate calls with everybody specifically. If that's where people would like. So far no other questions. If that is the case, we probably have one final poll and we'll put that up right as we wait for everybody else.

Next week is the last of our three sessions right now for the session. So quick question. Who's attending it? Well, that's where we're gonna have a bit more of a deeper dive into data. That'll be with Alex Carrie. So you would have seen all three of our superstars in the SE side.

Again, it will be available on demand late. So people do want to watch that. Time for questions and everything will be during the session. I will be in that as well. Any questions people would like feel free to say that over to me.

Sarah has just plopped the link in the chat so people can sign up for it there. Again, no other questions. So I think you've done a great job in answering a lot of them during the session of Andre. Probably the final thing I will leave people with as poll answers do flow in. We will be hosting a Canvas Connect event.

So a lot of the questions you might have, you'll be able to ask us in person live in Liverpool, in a one day event. I've just added the link in the chat to that event as well with people more than happy to more than welcome to sign up for and what we, there'll be speakers from different universities, different colleges there as well, to show what they're doing their environments. It's, an event set up by us, but very much driven by customers, and other people who have things to show things to show you on how they're doing, law suggestions for market community there, as well. Otherwise, as I look, and it's quite in the Q and A, and, quite everywhere else, we will sign off. Besides for the final question, is Canvas thirty three or is it just trial? There is a trial version of Canvas with limited integrations but pay a paid full version of Canvas is available as well.

My email in the chat, I will put that there now for anybody to take over If there are any questions, queries, around getting your own cameras license or any of the things we've shown today, please feel free to reach to me. I'll happily set up a call or introduce anybody who needs you need to be introduced to, to answer any of your questions. Otherwise, one minute to spare. I think you smashed it, Andre. Perfectly within time.

Thank you all for coming today and we hope to speak to you soon. Thank you very much, and, goodbye. Thank you. Bye bye.