Rocky Mountain High: Create MasteryPaths Aligned with Outcomes

Welcome to Rocky Mountain High, create mastery paths aligned with outcomes. The title is a little bit of a teaser. Today we're gonna be doing some Colorado based trivia. And give you an an opportunity to really try some things out today. And then we're gonna show you the back end of it as well. So we'll get into all the details in just a second, but Let's start with, introductions first.

My name is Eric Hills. And this is. Cara Osminson. Yes. I think so.

Okay. Sorry. Hope so. And we are blended learning coordinators from ShakaPI, Minnesota. Which is really close to Minneapolis.

It's like twenty minutes out of Minneapolis. And you might be looking at that job title there and going, what is a blended learning coordinator do? And, it seems to change quite a bit and our title is kind of a weird one in my opinion. But really weird tech integrationist for our school district. We serve k through twelve, in a district of about eight thousand students. Roughly, I'd say about six hundred, teachers that we're supporting.

And we are also canvas, admin as well. So we're the ones who are reading the release notes and figuring out what features we wanna promote with our teachers. We're helping them set up their classes. We're doing all those kinds of things with our, staff that we support. Yes, we are.

So this is our plan for today. We are all going to take a trivia quiz on whatever device you have available, you're going to be joining a Canvas course that we have. We've also put that course in commons. So if you want to use this for your own, professional development purposes, you can feel free to do that. We're going to complete some tasks then based on your quiz performance.

So based on your quiz performance, the mastery path, the way it's set up, will assign you a task. You will be able to view your results in the learning mastery grade book as a student, and then then we will come back and show you from the teacher's side. What that looks like, how we set some things up, how to look at that learning mastery grade book as a teacher. And then like I said, we will give you access to that course as well if it's something that you want to play with later. I should also mention we're gonna give you everything we show you.

So Kara mentioned that we're gonna put our course into comments. It's already there. Our slides will be provided to you as well. And yes, we're letting you get into our instance of Canvas. And then I'll just give a quick disclaimer.

We'll just delete you in like a week. So, if you decide that you had a good time with our trivia quiz today, and you want to stump some of your colleagues this afternoon or this evening at the the gathering at six o'clock and you wanna get them in there. Anybody is is welcome to pop in there. Again, we'll probably just delete you within the week, out of our instance because you know, we don't wanna pay for you. Sorry.

So Or when we remember to circle back to it? Yeah. When we remember to delete you, but it it will be quick. So with that, what we are going to do is get you enrolled at this time. Any device, you know, whether it be your phone or laptop, the link is over there. It's b I t dot l y slash capital m capital p and lowercase.

Oh, so that it is cap sensitive. Capital o. Yeah. Capital o. Sorry.

When you get in there, it's going to have a screen that looks something like this here, where it's going to ask you to enroll. You're gonna enter your, email address. And that's the easiest thing to do for your username because you'll probably remember that. Click that you are a new user because none of you are from ShaqB. I already know that.

And, and then also for full name, you can put, you know, whatever name you would like. It is helpful if you want to, you know, kind of show off today. Maybe you know Colorado trivia really well. Put a name in there because we'll have some names up on the screen later. And then check the box that you agree to the acceptable use policy Are people getting in? We will come back to our link in just a second in case you needed it again.

What our course looks like is you should see something like this right on the homepage of the course and a blinking start button. Cara's gonna tell us what we need to do once we get into that course, and then I'll put the link back up there for those of you that need it. Yeah. When you click on that link, it will bring you to our trivia quiz. You are going to take the nine question quiz and then you can view your feedback in the quiz when you're done.

And then you will it's a new quiz. So you need to click on the return button, and that'll bring you back to the module, and you can do the assigned work, based on your performance. And then if you go to grades, you'll see we have home modules and grades available in the navigation. You can go to grades and see the learning mastery grade book, what that looks like for you. We have aligned three outcomes in our trivia quiz.

So you will see your performance based on those three, outcomes history, Colorado history, Colorado geography, and Colorado pop culture. So we'll take fifteen minutes. We'll just put a timer on. We're happy to wander around and help if you're stuck with something. We'll stop early if people are ready to go.

And then we'll look at it from the teacher's side. Does anyone still need the link? Yep. Yeah. Okay. I'll go back up there.

There it is. Alright. Good luck. And I should also mention if you do get stuck or lost within the course, If you click on modules, it'll really take you back to where you need to be, and it'll show you what items you need to complete. Alright, everybody.

How do we do? I go okay? Are you intimidated now? I mean, some some locals are like, oh, I even didn't do great. So as we mentioned, our slides are available. So it's the exact same slideshow. That that we've been showing you here today. So If you are someone who delivers professional development, steal it.

Take it. Use it. Post it wherever you want. We don't care. Use it.

Take a picture of that link because I'm going to move on shortly. Once all the phones are away, I'll begin. Feel free to come up afterwards and talk to us as well, and we can get you whatever you need. Okay. I've got this one right.

Oh, there's a red line on it. That means it's mine. Alright. So I wanted to give you a little bit of a view behind the scenes of what this looks like from a teacher's perspective, what we did to differentiate what kinds of assignments all of you had based on the score that you got on your quiz. So you really took a kind of a, pre assessment for a lesson or a unit on Colorado, and we divided you up into three different groups.

We have our highs, mediums, and lows, or whatever you want to call those categories. And, what mastery paths does, has anyone ever seen this screen before? Okay. So I also I'm, I mentioned this to a couple people beforehand. This is a part of Canvas. This isn't an add on.

This isn't paid you know, if you're a Canvas customer, you've got this. There is a feature setting within courses. Or if you don't see that, it means that your admins have not enabled this feature. But it is available. So it might be something you need to check with your admins with if you don't have it.

And the way that we built this out is, we put first of all, at the bottom. Some of you probably fell in the let's catch up, core concept review which if we were face to face with students, we would probably just say, Hey, you're gonna meet over here at this table, k, and talk with the teacher and and work through some things. And then you have an opportunity to retest your knowledge and see what you learned both from the feedback on that quiz. And your time with the teacher. Our middle group here, had a assignment to go look at what they needed to, what you needed to work on you could look at the learning mastery grade book as a student and see, you know what? I did really well at geography, but I really do not know Colorado history.

Or pop culture or, you know, vice versa. So you could pick one topic to go research more. And then, of course, once again, retest your knowledge, see how you did. And then our top group, we kinda this was kind of an enrichment activity. Did anyone score on the top by the way? Okay.

We got a couple nice job. Alright. This is a tough quiz. So that top group got an opportunity to choose between three different assignments. So you'll notice here down here, I'm gonna fall off this stage.

There's an and right there, which means that students are automatically assigned to do both of those things. We'll show you what it looks like in the grade book as well. Up here, I said, you know what? We don't need you to do all three of these things if you, you know, we don't wanna give you more work because you already know this stuff. Instead, we're gonna let you have a little choice in what you would like to dive in deeper and learn more about and then give you an opportunity to share some things that you learned in your research or on this topic. Any questions about the mastery path set up right there? We have a nice small group, so please just feel free to shout out, let us know if you have, if you have questions.

I should also mention this screen shows up in any graded item. So if you have mastery paths turned on, you can use it for an assignment or a quiz. We used it for a quiz because then we can just say, ready go do it and then it automatically assigned you content, but we could also do an assignment that we then go in and grade and then it determines what content you get based on the grade that we assigned you, that you earned. I mean, that's what I meant. You can also use it, for choice.

Right? So you could make it a quiz, but say choose one, two, or three. Based on the score, based on the answer. Students might be assigned a, you know, you're going to work on, a poster. You're going to work on an essay, whatever that may be. Students can choose that, and you can set it up.

You can manipulate it that way. So what would be maybe you're gonna do this? So, like, I got four out of nine originally. That's not gonna affect my grade in the classroom. But then, like, I got six out of six on the reading test. Is that where we go on the grade book then for the student? So the question is, what what grade is ultimately gonna show up in the grade book? And that's where things you'll wanna plan ahead a little bit on.

For all these items, we just said, Hey, they're all graded because, you know, it's it's all of you. In the classroom, we would probably say some of these assignments might just be considered formative that they, you know, I checked that box that it's not gonna calculate into their final grade. The way it is set up right now is depend in everything's worth zero points except the quiz, and the re quiz. It's not going to, or while all of those things would impact your grade. Now if someone scored in the someone over here scored in the six through ninth points category.

Right? These don't show up in the grade book for them because they're not assigned to them. We'll show we'll show what that screen looks like on who actually got assigned. Yep. We'd love to be. We are not.

Yeah. Yes. Good question. We we struggled a lot with how we wanted to present that here too, though, so that it would, it would represent that knowledge. And so It's, I I did this as a, a fake student and failed and then, you know, did fairly well and then got six out of six.

I I extended myself more takes on the retake as as one can do. And I wanted to make sure that what was in that learning mastery grade book was reflecting that progress. So we have it set up sixty five thirty five decaying average. So the way we currently have this grade book set up, when I did that quiz, my first attempt, three out of nine, whatever that was, counts. It's in the grade book.

But as I subsequently, did better on the retake or if I did other assignments with those outcomes, the the more recent would start to impact my grade more, and that initial quiz would impact my grade less. But you could choose how you want to set that up. That is how we set this, this course up. So we'll we'll come back to outcomes a little bit too. I think because that is that's another big part of of how we really set everything up.

So what we did is since all of you had probably slightly different questions, we had this quiz, initially has fifteen questions in it. But you only took nine of them. So we created, item banks and then randomly selected three questions from the history pop culture and geography topics. All of those questions were also aligned to an outcome. Okay.

So they're in a question bank, but they're also aligned to the outcome. The outcomes, well, is that our next slide? I don't remember. It is. It is. Wait.

No, it's not. But it it is now when we skipped over that one. Think you're at this one. Right? I do. Is that what you wanna do? Okay.

Yeah, we're trying to to model a variety of different concepts You can do mastery paths without outcomes. You can do mastery paths without using item banks. But we like how you can combine those things together to get a different picture. So the outcomes, in Canvas, outcome is a standard or learning target, or, you know, however, you define that. You can align outcomes with many different things.

You can align them with item banks. So All these questions in a bank. All those questions are now aligned to the history outcome. You can align them. You can use them in assignments, you can use them in discussions, so you could have an outcome based rubric, and you can do it whether or not you're standards based.

So they're they're really very useful. You can do them in just a course. You can create them at a account level or sub account level. Yeah. Right? So you could have outcomes for, a course that all teachers teaching that course are using, for example, and we were talking about mass repas we got started here and it does take a lot of work to set this up.

But it's very, very purposeful, right? It makes you or the teacher, the designer, whoever's going through the process really think through each of those pieces to make sure that you are supplying the follow-up, the assignments, the connections, that you want to with students to be able to use that data. So, we are not as we mentioned, we're not a standards based grading district at all. We do have some people that are kind of dabbling, that are curious. We would love to move that route, but we we don't make those calls unfortunately. But one other way that I really enjoy using outcomes, and this is completely divorced of anything we've thus far talked about.

Is that you can so easily pull them in as criterion within a rubric. And that makes rubric creation so much faster because it can be kind of tedious to type into those little boxes at another criterion. Duplicating rubrics, occasion, people kind of goof it up and then they edit the rubric from another assignment or, that kind of thing. And so I love this because you really can you see over there on that rubric, creation screen. It says find outcome.

You click on that. Any of the outcomes within your course or within your institution, pull in as a criterion and whatever has been built into that outcome kind of as the rubric that you you build when you make an outcome. It pulls in too. And then anytime a score is assigned to that specific criterion reflected in the learning mastery grade book. And as Cara mentioned, more recent data tends to have a heavier weight based based on how we set it up.

Within our course here. We're both, social studies teachers by training and, experience. And we both really like the idea of using rubrics as well for those thinking skills that are consistent throughout you know, like in social studies, these are the skills we are working on. Doesn't matter what era we're studying right now. That is a different school, you know, that's your content.

But we wanna see how your writing grows and changes over time. So we're gonna put these outcomes in our writing rubrics. Or are, assignments leading up to a written assessment, that kind of thing. So here's what the the learning mastery grade book looks from a a teacher's perspective. We got a couple of screenshots in here.

And so again, you could use this if you're a standards based institution. This could be what you actually put in your grade book. We use it more and what I've seen teachers use it more as is a means of targeting, specific skills that kids need to continue to work on. So there was a a English department of seventh grade teachers that I worked with who every Friday, they had focused Fridays where students would look at their student learning mastery grade book, identify one skill they wanted to work on And then the teachers kinda had a library of different assignments that they could complete to, you know, continue working on that specific skill. And that was kind of face to face low tech assignments, but it gave them data to say, here's what you need to work on.

And the, you know, putting choice and, or, you know, giving kids some choice gives them ownership of their learning, and they're more motivated to do it. Right? I said all that. We're good. Do you wanna look at the real live one? See some people's scores Hopefully, nobody gets too embarrassed about that. I'm sure some of you just zipped through and just guessed because you were trying to keep things moving.

Right. The beer question with four pictures didn't necessarily load. Check it out later. Good history there. Okay.

Sorry. I want to go to grades. The wifi is loading slowly. What's that? There was a question about the history of beer in Colorado. It was it was a little intensive.

That's that's my kind of I'm the beer connoisseur. She's the trivia is forty seven sentences long when she writes a question person. Alright. This will eventually load. I I hope.

Oh, cars got it loaded. Yeah. Let's just swap right out. Hopefully, that doesn't screw up our AV stuff in the back there. Tada.

So get that. Okay. So here's what it looks like on the teacher's side. When you click on to learning mastery, you have to turn the learning mastery grade book on. You can turn it on just for students.

You can turn it on for students and teachers. We've got the course average up here for each of these outcomes. So for geography, one point four. Out of three, two point five, I put his mastery. We did, better, a little better in geography than history.

And pretty well in pop culture. We had quite a few people who, got their three out of three on their pop culture. So this is what the array looks like. And then if you go in, so this was my sample student. My dog's name is Britta.

So Britta boo. That may not load because it took me a while to load the other piece, unfortunately. But you can see over here, it tells me, the most recently graded items It would show fail. You you yep. Sorry.

You can take this out of the comments and and use it yourself and you can dig in and see a little bit better what it looks like. But, it would break this down for each of the attempts. So when I click on that, what should do is say geography, history, culture, and then under geography, it'll show the different assessments that were taken. And so you can see the progression over time going from zero on the first history quiz to, you know, two out of three or one out of two, I think, on the retake, on the next one. So you can, as a teacher, you can look at this pretty, specifically.

Yes. John Allway. Yes. Is that the? Oh, I guess I closed the other window that I was in there with Brita, but I'm gonna click on people and see who didn't act as a student. It's being really so slow that you may not be able to.

But, yes. We're gonna try. You can see that. As a student, you can see that. So can I be John Elway? Just this once? Yeah.

It's just This is your nightmare. Right? Amazing demonstration of your technology. So sorry. Yes. Yeah.

Yes. Yes. Very good question. I'm gonna repeat it because I was told on the recording, it's going through the microphone. So the question was when, the quiz is being built out, how do you align it with an outcome or an item bank? Is there, you know, what does that look like? One of the important things to know, just jump back to the slides, Eric.

It is very different for classic quizzes and new quizzes. Is there anyone in here who's using new quizzes exclusively in your districts or institutions? Good for you. We're not there yet, but, there are some specific steps you have to go through. And with new quizzes, there's kind of an extra step right now. So we actually created a quiz where we built all the questions, then we went back and created the quiz we wanted for the mastery path.

But with, with a new quiz, when you are building that question down at the bottom, there's a little carrot, and it says outcome, there's a little carrot, it says item bank. So you go in, you select the outcome you want, you go in, you select the item bank. And it does remember your most recent choice. So if you do like all of your history ones together or that if you're doing this kind of a quiz, that's helpful. Yep.

Okay. Quite a few hands. Okay. So from classic quizzes to new quizzes using outcomes and masturbate as an yep. Can I jump in there? So originally, we actually did this in classic quizzes.

We did this presentation about four years ago. And it was, all 80s rock. So, you missed out. I think that was that was rock being one of the outcomes. That's right.

That's right. That one actually still is in commons if you search for create mastery paths along with with outcomes. So we did that all with classic quizzes. When, I believe it's, is it this month? Next month, they're they're you're going to be able to migrate classic quizzes, which take your question banks and put them into item banks. Is that confusing? Yes.

But we you should be able to convert your quiz into a new quiz. The one thing I'll say and this is this is why we're kinda back and forth on new quizzes versus classic. We forced ourselves to learn new quizzes for this presentation. We we generally lean on classic quizzes because we know the we know it better. But as you were taking the quiz, there are a number of items that are specifically, only available in new quizzes, like ordering categorization the hot spot questions.

We we love those questions, and so that's why we, you know, we thought it'd be a cool way to do a quiz. We didn't force ourselves to learn new quizzes, we've used new quizzes, but with the outcomes and the item banks and things. And so there there is a specific order of operations you have to to do. So Yep. So as we mentioned, we've got the course in commons now.

So if you search Rocky Mountain High, you'll find it. There is also our old one called I think it's just called create mastery paths aligned with outcomes. I don't know why the outcome got cut off there, but that's our old one that had the the eighties music quiz. So it's kinda it's kinda the same concept Another fun quiz to take to my happy hour. Right? If Twitter doesn't die in the next few days, you will see that we have some tweets available for you.

I I tweeted out some things that are, again, like our links to the slides and the course and all that stuff. So you can go check that out. Again, we'll be around for questions because we're presenting in fifteen minutes for a different topic. So thank you all for coming. And have a great, evening.