Better LMS Visibility, Deeper LMS Adoption with Impact by Instructure
How do you measure your learning management investment? How do you make decisions on how and when to intervene to drive adoption and best practices? Learn more about Impact by Instructure. You'll see new functionality designed to give you actionable LMS usage insights and innovative methods that drive the efficacy of LMS adoption. We'll also share tech best practices that actually drive learning forward.
Thank you all so much for being here. We're gonna be talking about impact and how to get better visibility into your LMS. I'm Tara Goldman, VP of Product and Instructure, and I'm really excited to have some special guests with me here today. We've got Kathy Fernandez from CSU Chico. And we've got Lim Nguyen from CSU Long Beach. And I'm gonna talk to you a little bit about impact, what it is.
Some new product updates that we're excited to share, but really wanna spend the majority of our time, right, hearing from our special guests, what's worked for them, some success stories, and maybe some takeaways y'all can take. Away from Instructure Con. So, like I mentioned, you know, before we get started, first of all, I know it's the end of the day. It's been a very long day. There's a lot of information coming at you, but I hope that it's been really rich and helpful as you think about what to take back to all of your institutions.
We're gonna cover again how pact helps institutions who are using solutions within the within the Instructure Learning platform, product updates, and again, just a little bit hearing about, you know, how these two have implemented impact within their institutions. So we've been talking a lot about the plat form. Right? And impact embodies just that, that platform approach to measure the adoption and engagement and intervene across your teaching and learning systems. Impacts a way to empower all of your institutions to better manage courses, curriculum, and educator student interactions in a unified platform, providing everyone with a really seamless connected experience. So before we get started, we'd love to hear from all of you just get some a little little interactivity.
Right? And under and know what you would like to improve. And I think that this is not working. So maybe we have to skip that. Alright. Yeah.
We have it. Alright. Well, maybe we can shout some out. In your LMS adoption and engagement. Tool adoption.
Tool adoption. Quiz use? Just in time, help. That's a great one. Message students who. Message students who.
Another one. Alright. So before we dive in, by show of hands, how many people here are familiar with impact? How many are current customers? How many don't know anything about it? Alright. So we have a nice mix of folks. So you we all know that an LMS is very resource intensive.
It's a big investment that you all make And so what we wanna provide with impact is a way for you to understand insights on how your students and faculty are using Canvas, but more importantly, how you can set up targeted data driven interventions, as well as provide in app support. Something we've been talking a lot about, right, today is AI. Right? And as you all go back to your institutions, get ready for false start. It's a big topic that you're probably engaging within your institutions, and think of impact as a way where you can share resources, right, make sure that everyone understands how you wanna think about it, how you wanna leverage it within your institutions, provide that in app support These are just a couple of ways that impact can help you on a day to day basis. So I'm gonna talk through a couple of updates that we've made on the product side.
We've put a lot of emphasis in our platform approach over the past year. We've been investing in unifying our look and feel, ensuring that we provide better support and really giving you deeper insight into your ed tech. So we're gonna start with walk throughs, which is something we are really excited about. Walk those are essentially a step by step, guide, right, that you can give your users to instill best practices while providing a company in Compton. They're a great way to have another tool in your toolbox when it comes to LMS optimization.
And what's great about it is it really saves admin's time when it comes to supporting your faculty and students. We've seen some interesting use cases across institutions when it comes to best course design practices, tool rollouts, which is what I heard earlier, resource adoption, compliance campaigns, accessibility, student to student collaboration, so many different use cases. And we've also provided over thirty out of the box options, which enable you all to just leverage. Right? These are the top use cases that we've seen from tuitions and just start, you know, going right away. So you can see some of this here.
Hopefully, it loads. Oh, yay. It's working. This is an example of just that step by step adoption. Another use case we were talking about even earlier today in the k twelve session is new faculty onboarding.
Right? They need different support when they're coming on board. Their experience is different. They need to understand how to leverage canvas, how to implement it, and there's ways to really you know, walk them through step by step how they can, use it in in their courses. Okay. So the next update is mobile data.
We all know mobile is a huge component of canvas, right? And we're so excited to share that this data is now part of impact where you can utilize those insights to dive deeper into that usage across the campus student and teacher apps, both iOS and Android to understand what is happening, where are their areas to improve, across your faculty, students, parents? How can you better support them? And really kind of drive that adoption and engagement. User groups is something we're really excited about. I think we can all agree that we've got a lot of information coming at us every day, email, chat apps, notifications, lot of stuff. Right? And it's critical that as we think about how we support our users, we give them the most targeted information for what they need to do. And with user groups, admins can really customize audience segmentation and tailor that messaging so that you're sending the right information to the right student or or faculty member at the right time.
Some use cases that we've seen work really well here are creating targeted interventions to groups in a particular subaccount, or, you know, we can kind of create dynamic groups based on user activity, or if you've got CSV uploads, that's also supported. We wanna make sure that we can really be intentional about what we're sending each of our custom groups. So subaccount access is another enhancement that really extends the value and evangelizes what impact can do across your institution. Some institutions have teams of folks. Some institutions are a one person team.
And so what this allows is, someone to empower other folks within your in institution, to have that relevant access, to have that granular data, and be able to send, again, those target interventions for whatever they need to do. For example, you may have a hierarchical structure, right, within your institutions. You may need to understand specific usage within a particular school. And this enables each of those subaccount admins to target campaigns for those particular use cases. Later on Lim is actually gonna talk about how he uses a dead keyated subaccount in Canvas as a sandbox experience, for how CSU Long Beach gains insights.
So the other update we wanna talk about is campaigns redesigned. We also redesigned the insights, section, which I'll talk about in the next slide. And this is really all about creating a more cohesive user experience. We're leveraging Canvas InstUI, and just are starting to bring everything together into a really cohesive end to end, experience as we think about our platform approach. We've redesigned both of these sections for both user friendliness and accessibility, And there are some upgrades within both our campaigns and insights sections where, it's now more interactive.
It allows you to really understand the workflows from within the page. Start a campaign right from here. And on the insights section, there's an ability to really interact with these graphs. And download these, these files where prior, I think a lot of folks were struggling with just taking screenshots, being able to share those across your institutions. So I'd love to turn the conversation over to Kathy and Lim.
And before we get started, maybe each of you can introduce yourself your roles, how long you've been at your institutions, what you're accountable for. Kathy, do you wanna go first? Sure. Kathy Fernandez, academic technology officer at Chico State. I've been in the CSU for thirty five years. And, we bought impact back when it was easy soft at the, really, the beginning stages.
Hi. My name is Living Winn. I'm the LMS System admin, for the campus. I've been the university for twenty three years. We had, Blackboard, Beachboard, or what we call it, Bright Space.
But now we just go fully on Canvas right now. And, my team consists of, two SIS admin, including me, an LMS support and a technologist. Awesome. So Kathy, I'm gonna start with you. What initially drew you to impact? So especially post COVID, but even before COVID Chico stated had a discussion about, none of you have enough email.
Right? You all want more email and post COVID, especially faculty, and students ignoring emails because half of them maybe don't pertain to them or not just in time. So Chico State started talking about, you know, students need administrative emails. Like, hey, tuition is due or maybe something from the president. They have their activities. We're wildcats.
So, hey, what are the wild act wildcat activities in student clubs? What's going on there? And then they have their academics, why they came to Chico state. And therefore, we wanted to be able to pinpoint and focus the communications we needed specifically do the students or specifically do the faculty. And again, depending on their usage or where, you know, what their role is within the, LMS being able to target messages. Awesome. Lynn, what about you? It's not as cool as Kathy here, but basically, there's a mandate of pretty much us going to Canvas.
I was told that we're gonna switch it to Canvas early January of last year. And, oh, an impact is is included with that. My marvin right there is my director. Told us to, have it, told us in January to, hey, let's go with Canvas and were told to do it in spring, told him that you're crazy. So we went with summer.
But, once I start to, to start using Canvas, our impact. I think it's a tool that I don't know why we I don't think we could live without it anymore. Awesome. And obviously, I shared a lot of more tactical features within the product, but when we kind of talked a couple of weeks ago, we really talked about how to strategically set up your institutions, to not only implement impact, but leverage it, optimize it, and think about the entire life cycle of it. And so as you think about not just yourselves, but your teams, I'd love for each of you to share how you've structured your teams, how have you supported impact, and made it successful for each of your institutions.
So, originally, our LMS administrator was the one in charge of impact, but it became obvious in a couple different ways Chico State was really focused on student success. I'm sure you all are. And we decided that, you know, a new student steps into Chico State. They've got a technological environment that is well in the internet and bits and bytes. And so we started actually across my instructional designers talking about Hey, in week zero, we need the students to go to the portal.
We need them to know that they have access to Microsoft license. What are the key things in actually update zoom. That was a key thing. And then in the second semester, second week, maybe there was something else we need to do inform them. So we actually used a Google doc with a template that basically did the full life cycle.
Now when is registration? Okay. This is when we'll put something an impact about, Hey, did you go to your degree planner? Did you at where you're at? Are you prepared to next week, actually, you know, get into and register for classes? So then each semester, of course, changes a little bit because, well, spring semester or holidays don't fall on the same dates. So we're constantly juggling as new things come up like, hey, it's time devote. Again, we we're very careful about not wanting all of the university to go, Hey, now we have impact. No.
We wanna focus on the academic environment, but sometimes we do put in other messages. Yeah. I love that. And I love how you've kind of really scaffolded. Right? Things that you know to be common use cases as you go through semester.
Can you also talk a little bit about the advisory group you set up to make sure that you're really collaborating across your institution? Yeah. So we have an LMS Advisory group. Again, this includes, you know, obviously, the support desk, while my staff support the faculty, of course, the other side of the coin are the students. So Making sure that the student support was in there. We have the registrar in there.
We have the accessibility folks in there. So this LMS advisory meeting happens every week on a Wednesday talking about so what's happening now? What's been requested? What is changing? And of course, we can't all keep up with all the upgrades now that we're all in the cloud, those upgrades happen whenever they're gonna happen, and so trying to keep everybody on the same page. So we use also the LMS Advisory to say we will be popping up these messages next. Mhmm. Yeah.
I love the collaboration that you talked about and just making sure that you're hearing from everybody and you're on the same page in terms of what's the most important thing that we can be supporting our faculty and our students with. Lim, I'd love to hear from you. Yeah. So, again, we just we're kind of a late adopter, so that's the dream of what we're heading toward. But as soon as we got impact, we try to start rolling out and how fun and, you know, and, and start to doing that.
But then we realized that it's a it's a lot of stuff that you had to deal with. We kind of pull back a bit and start to build the infrastructure. We start with the LMS support, the LMS admin team to look through the LTI connection, the monitor, the template, making sure that that's connected, then then the LMS support team in our end review the article, turn off things that isn't, that applies to the universe such as, you know, Google's, we're a Microsoft shop. So you should turn that off. Add in more roles such as, you know, we have a librarian role that we add in.
And then connecting those articles straight to the, the, the the templates and information. So that way when a when a instructor would come into, like, go into the people tools and As soon as they click on the, the impact support page, it's right there tying that all in first. And then we have the or technologists who looks through the, the data and looking through the, what's, what's being used or not. We talked about, like, different colleges adopting different tools and stuff, but we had realized that the sandbox data can also be beneficial. You could see what's, instructor are testing and playing around with, match it up with instructor that's using it.
And that way when you have, like, these instructors testing it, but they're not using it. Let's have a little campaign of, introduction. Those are the one that's using it. Let's make it immediate, intermediate or advanced, training for them. So that's kinda like the stuff that once you do the subaccount structures, you could get a lot of data, and you could really utilize, different ways of, of, you know, utilizing it.
And I know you think about Kathy as the gold standard, but you've done so much to get impact off the ground in such a short period of time. How are you keeping all these different constituents and stakeholders in your institution on the same page? The Yeah. You. Lovely. Yeah.
So luckily, they're all under me. So I've, I have this whole vision And, and, and then I, you know, we have weekly meeting, stand ups, sprint meeting, specifically talking about, you know, how it works and how it doesn't work. Play around with it. And then, pretty much take, you know, pretty much, you know, get feedback. You know, they say, Hey, this is great.
This is working. This is better. I'm not the smartest person, so You know, always getting feedback because, you know, the tool is super powerful and there's so many ways to do it. And each university is just different. And we're to and each customer is different too.
So, you know, we're we're just all learning it together in this big, wonderful journey. Yeah. I'll say, you know, as the instructional designers are supporting the faculty, where are the issues coming up. And, again, it's a life cycle. Right? What starts at the beginning of the semester is course copy and publish your course.
What happens in the middle of the semester is more of the feedback, the discussion, the quizzes. And so just trying to move everybody along. They're not getting this. They are getting that and leveraging it that way. We had two examples where we used to be Proctorio campus wide, then it only went to one college.
So again, not spamming all of them, but speaking to the ones that need to be, you know, told what's being adopted or what's being taken away. And then also, McGraw Hill, all of a sudden, started with, the advantage, LTI. Well, again, don't bother all the faculty with that. Just go in with impact, find out those that are already using that particular LTI and send the update message to them. I like to add on to it because I get super excited about it.
One of the beneficial of pretty much impact is to, pretty much, targeting groups. So when you say, hey, you know, at the beginning of the semester, remind faculty to to publish it. Previously without impact, it's a big announcement. Hey, don't forget to do this. As more emails start coming, don't forget to do this.
Don't forget to do that. But professors like, I'm not an idiot. I know how to do this already while other isn't. With this, you could really target them like, Hey, you didn't do this. So we're targeting you.
And you could and for those advanced users, you could just leave them alone. Yep. I'm pointing at you. Yes. Some of the themes I'm picking up is an iterative approach, right? Because you may not know what works, but you can really learn from each of your campaigns.
It's kind of how we develop product. Right? We get feedback from all of you. We need you need that feedback cycle to understand what's working, what's not working, and how do you get better? In the LMS Advisory, we always go through the thumbs up and thumbs down. Okay? And then why did they do the thumbs up or the thumbs down? And so in finals week, we had said something about, you know, don't forget it's a good time to take a deep breath, take yourself for a walk, or whatever the case be. Well, you know, getting the thumbs up and saying, yeah, or those kinds of messages, which has nothing to do with technology, but just being aware of the environment, So that's been a beautiful thing to even be able to see the feedback and see where we need to improve.
And for those who don't know what that is and impact, what is the thumb and thumbs down. Okay. So when you put up a a message and it pops up, students and or faculty, depending on who you've sent the message to, can say, yep, that message was a good message for me, or nope, that message didn't apply, or you missed something. I don't understand, you know, you used an acronym. What does that mean? So in addition to just seeing like how your campaigns are even working, you're also getting feedback from your users around.
This was a great message, not so great. Yep. And next time, we're changing the message because this was confusing. Yep. Awesome.
Thank you for sharing. Alright. Next question. Where have you both seen the most success with impact? Well, again, getting that student feedback, what we've started to realize is freshmen being introduced to Chico State don't know the technology environment. So, of course, we need to let them know along the way all the technologies we want them to know about.
But by the time you're a junior, it's like I've seen that message a few times. So now it's starting to think about, well, okay, now do we need to start targeting differently? Based on what level, at the institution you've been. But I, you know, overall, we just keep falling back into leveraging impact in multiple ways. We we too are migrating to Canvas, so we actually had impact times too. Letting people know that they were coming off Blackboard, letting people on board to, impact.
So having both of that was very helpful for different messages. I know we have a visual here about what you spoke about earlier. Right? Really thinking about that life cycle, that week zero, what are the most important things? Week one, what are the most important things? Can you talk a little bit about these templates? And I know you have a very robust tracker -- Yeah. -- and system. Yeah.
So, again, in a Google doc, you know, this is what template looks like. And then in the Google doc, every single week, we just keep adding on week two, week three, week four. If we put in an image, of course, we want an tag, you know, what was the main reason why we decided to do this? When is it gonna pop up? When is it not gonna pop up anymore? So, again, it sets up the structure and the planning And if something pops up, let's say the second week that we're like, well, we're not gonna do that next week. Let's look out at the fifth week. We can start putting it into the Google doc and therefore plan going forward.
So we have for every single semester, a Google doc full of, again, what we've done. And then we also usually snapshot what was the actual message, because as you know, when you format, it may look very different than putting it in the Google Doc there was an and then the other thing we do is we take a lot of data out of impact. And on our campus, we have somebody who's very good at Power BI. So pretty much on a weekly to monthly basis, we are looking at all the tools integrations, you know, interesting seeing the learn platform how we're gonna be able to see the LTI tools there. But we actually have slides on every single tool and and, you know, when it was hot and, popular in the semester, and when it tapers off, so we use all of that data, but obviously through Power BI.
Awesome. Lynn, where have you seen the most success? I think the most success is pretty much, for me, the LTI data, the data itself. There's certain of tool, Respondus LockDown that you can't get data from the vendors. And so, Impact can do that. Read speakers, give you more information data.
But, understanding how, impacts gets the data, which is, you know, pretty much when they go on to and click on it, compare it to the vendor's data, and that will give you a good story of when are they clicking it, when they're actually using it. So that's been a really good, for me, it's the most important where you could actually further leverage the data itself of, of when, when, and where, and what time they're clicking. Awesome. Alright. I'm gonna go into any best practices.
And I think let's do this in a two part way. Right? So maybe thinking back into when you were first implementing impact and you were getting started. You know, what are some advice that you would wanna share? Well, again, I think I've demonstrated that landing is, you know, communications is really important, and we don't just like, okay, create that message, send it out. No. There's multiple people putting their eyes on it, multiple instructional designers.
Hey, you said it this way, but I think this might be a better way to say it. So it's not just impact. It's also preparing your communications, and no surprise these days being very succinct. So, of course, we try to keep everything into a bullet four format everybody to quickly look through. So, you know, best practice is it's not just about the tool.
It's making sure you're planned and ready to leverage the tool best way possible. Awesome, Lynn. I'm more of a conservative approach where, the best practice is start with looking at pretty much where the LCI connection is. And then, you know, build it from the back end to ground up. Because we kinda started, okay, this is great.
Let's do a campaign. And then it kinda gets like, okay, where are we targeting and and how it goes this. Because when you do a campaign, you wanna also give, you know, support articles and where it is and on that demand. So I would say start with, again, with, the whole team of the LTI, you know, looking through your LTI, verifying if everything is is getting that data. Review the sport articles because you don't want to have it where of faculty would see the support or go, but, oh, yeah, we did disable this for instructors, but yeah, it's available, like resetting, resetting courses.
So we actually had to hide that and recreate another one for ourselves. Stuff like that. So clean that up, but, and then start a whole campaign, which we're doing right now early this year. I'll add to that too. We are also trying to figure out, you know, documentation when faculty get started on something.
It's documentation, meaning I know you need to know from beginning to end about this tool versus a knowledge based article, which is I'm just looking for a particular answer So also trying to, based on communications, looking at the, is this documentation? Where should this really be? And then again, lining up And then as as we're noting, the technology keeps changing and trying to stay up with the documentation and the knowledge base art articles are challenging. Yep. Yeah. Let me talk to a lot about in our prior conversation around course evaluation. Yes.
Can you tell the audience a little bit about what you did there? So So I know that the biggest thing is, you know, students are not taking course evaluation. We've used to be, Scanron class climate shot. We've briefly just moved to call straight queue classroom. We enable all these where, cool tools But then, you know, when running to, LMS systems figuring out how to, to communicate to to students. Now, obviously, the the system itself, whether you're using class climate or q or quality evaluation, when someone creates an evaluation, it auto makes sense in emails to the student.
Great. Right? It shoots it out. You don't know if they're actually reading it, but it's out there. And then, then there's another option where we pretty much make an announcement to, to, in Canvas. You know, hey, here's a course of values.
Do it. Don't know, no input, no, it's nothing. And then we we also try and we did another step where we actually sent, each individual students a message within Canvas, where they can be, message in Canvas, say, hey, don't do you please do your course evaluation. Again, you don't get any feedback from that. You just send it out and just hope for the best.
But with with impacts, what's really nice about that is that we do, a pop ups, messaging to the students. So the first week, we send, you know, we get a list of students that haven't done their course evaluation. We put them into group together, send a nice, pop up message, and you could actually wait and see what's going on. Oh, they're actually looking at but they're they're not doing the course evaluation. Oh, they're doing course evaluation because they're clicking on it.
Within the after that week, we clear out the group. We added we we again take a n the group again, the the the one that haven't done their course evaluation. Those are the one that that does it already. Cool. You won't get this message.
But the one that don't will reset it and get you this message again. So and you could see the trend of like where they're looking at it, where they're not when they're clicking on it. And after like four or five, you know, we can tell it ends and it ends, and then we gathered the data and we looked at it, What's the great benefit about that is that we could tell people like, hey, student are seeing these information, student are seeing they'll pop up because it's in the data. You can't have that when you're sending emails. You should send an email.
Hope for the best. So the conversation starts to become like, not like how we delivering the message is why students are not taking the valuation. So that's been a huge benefit, and that's one of the high stake impact messages that we're, I think, is a big success on. Awesome. I could go on and on, but Alright.
Well, I'm thinking about the future. What are you most excited about when it comes to impact in the future? Well, I know my staff are very interested in the walk throughs and since we're still have six hundred faculty to join Canvas' fall. It's first things first. I forget whether you ask this question. So I'm gonna sort of flip it a little bit, is that because we are doing, so many of the messages, we would like to be able to copy and then edit messages.
And instead, we have to start fresh. So that is something that we are looking forward to. And we continue to engage with Melissa and the CSU so that we can continue together to leverage the case studies that we're talking about right now. Awesome. I agree.
Walk three is the best. Mainly for our our support teams. We have a lot of, every semester always the typical faculty that comes in asking the same question. Over and over, we could just target them and give them walk through. So I was like, here's a walk through.
So, the goal is to have lesson the list. And as, you know, as we figure out more of the common questions arises, whether this new faculty or or, new staff or anything else or students, we could target like, hey, new instructor. Here's a list, and let's target this because it's the most common question. So walkthrough would I'm really excited about it. Yeah.
The Is there data on walkthroughs? Recently released. Do you wanna Excellent. Because I can see how many times does that faculty walk through that. What step they fall off on? What step they fall off on? Oh, very good. Yeah.
The culture of kind of self-service and self direction is huge because you all have so much to do. Yeah. And just reducing that the load that comes at you and really empower others to seek the information themselves or even really walk them through step by step, right, how to get it. Is gonna be so critical because at the end of the day, right? Our mission is really to help save educators time, this is one way we can do that. And then you can continue to iterate and improve what you're seeing in your particular institutions to really hone in on where you can continue to provide that support.
Yep. You got it. Awesome. So maybe we can go around the room. I'm gonna steal one of these mics.
And understand where folks see impact where folks see impact being instrumental in their institution, and then we're happy to open it up to Q and A. So one of the things we ran into just last week was, we are during the summer, we roll out a lot of LTIs. And when they pop up on navigation, we really can't control it. So what we've done, is we're looking at when I see the tickets when an LTI is coming through But when ITS is going to actually add it to the to the navigation, we have resources in confluence ready. So if they hover, they see it.
So they don't call us and say, what is this? It stops that that call. So it but I love now I'm thinking because our biggest question at the beginning of semester is do I publish my course? And it's every semester on the first day class, it will publish. But if we had something of it where they went to go to try to publish and it said, Hey, this will happen So -- Don't worry. -- just gave me a little like, uh-huh. We could do that.
But it is about cutting down on on the work and and having them self serve. So I love that part. Yeah. Definitely. And we did have to change our wording.
We found that if we ever said remember to or did you remember or did you know we got the, yes, we knew. Do we need to, you know, so we did. We just left it as, you know, this is the first, you know, publisher course this this time or or do this and they didn't get offended. It was almost like we were offending them by saying, you did they didn't remember that. Well, you're already doing the content iteration based on what messaging is read as resident.
Yeah. On the feedback we get, Yeah. Anybody else? So, great talk. You know, I got so many ideas. I've already emailed you both.
But, one of the things to Liam's point was students taking action. So we have an annual IT survey. Faculty response rate great. Staff, response rate. Great.
Students, not so much. One of the things about it was they always ask, what is your preferred method of communication? And the university and my colleagues in IT always thought, email because the people that respond to the survey. Select email. So they asked, how do you distribute the survey? Oh, through email. Is it sent any other way? Nope.
Give me the list of people that haven't used or haven't responded. And let's see what we can do on, with impact. So we went from forty something response rate to ninety eight percent response rate. And immediately, it's demonstrating with, like, hard data. Look, within a week and a half, we went from forty something to ninety eight percent.
And the jump up into the ninety eight percentile was within forty eight hours. So it's like changing the perception because just as it is that every university, they're in love with their own words. So the short, very direct messaging is we're shifting that sort of we're gonna send this email and will bury the lead in the third, fourth paragraph. Now it's just putting it in their face, and we're getting actionable results on it. And you know when they say, emails by preference? Well, for what kind of message because there's a million kinds of messages.
So it's not the preference for every kind of message. And please don't nag me a hundred times, but then there are those that procrastinate that need the nag. Anybody else? So we're happy to open up to Q and A. Before we do that is folks raise their hands. Right? If you wanna find out more, there's a lot of information on our Canvas community.
There's impact universe. We've got an impact booth here. And, of course, our roadmap that's constantly updated. We do that on a quarterly basis. But we also update on a monthly basis with blog posts from our product managers.
So, yeah, we have questions. Okay. Yep. I already got the mic. Alright.
So, I have a cue that needs an a. It's, so can you talk a little bit about frequency of these different interventions that impact can provide. So we're new to Canvas, and therefore, we're new to impact. And we see a lot of potential, and we're excited about the things that we could do, but we also don't wanna become the people that are annoying the heck out of faculty and students. We also see that we have an opportunity to set kind of an expectation at this point by how many how frequently we do this.
But how did you all find the right frequency? Did you find a sweet spot? Did you settle into it right away? Did you get a lot of feedback from faculty saying this is too much? I like them. Give me more. Just kinda what what sort of experience did you have finding the right, that sweet spot? Well, what's really nice is, we send out that weekly success message I talked about, and we show students if you don't wanna see the we're gonna send it out weekly. So if you don't wanna see it for the rest of the week, then just say, what is it? I'm done at the bottom. Don't show again.
So in some sense, it's we will do it weekly and you get to choose whether it continues to pop up or not. Part of it is understanding the technology. We're still kinda like, figuring it out, but knowing that, okay, an email will send to their email box, and it's gonna be thrown in with a bunch of emails. Impact doesn't send email. It's a message when they log in to to, to Canvas.
So it's like if a week later a student logs in and boom, there it is. And you actually could see how many students, is clicking on it or seeing it and whether you want to turn it off at a certain time or not. It's really just depend on you and you kind of has player. The best part of it is that you could give enable feedback. You can give them a thumbs up.
Send a they'll send a message like, hey, this is great. This is not working. And and and you can adjust as needed. And you actually see the graph when they Yeah. So, I mean, I would think about it kinda like an AB testing tool in a way.
Right? Like, you're gonna try something out. You're gonna gonna see how it does. You're gonna maybe it's working, maybe it's not working, and you're gonna use that data in those graphs to say, how do I improve on this? Maybe it's too often. Maybe it's not enough. Got one more question back here, and then I'll start heading back up there.
So, the out of the box monitors, do you find that those were sufficient or did you have to create a whole bunch of to monitors to really get data on the pieces of information that you wanted to know. Not a lot, but I suggest to review it. Because I like to review things, and I do have to adjust certain things because it's not monitoring the way I want it. Out of the box is great because a good starting point. Review, I suggest reviewing, what's is really important, add on stuff that's also really important.
That is not there. It doesn't take too much time. Maybe, I think, maybe two or three weeks with a few, like, as you kind of work on and you see certain things missing. But, yeah, out of the box is great, but I will suggest to to review it just in case because they might not be monitoring just where you want it to be. Yeah.
I was gonna say same thing. In inevitably, it's, the feedback mechanism. It's just making your way, through those things, and making it some kind of routine for us, it's the LMS Advisory group. Yeah. So my question is more about getting support for purchasing the tool from upper leadership.
So I have been on a crusade for over a year, to try to convince my chain of command, the people that, operate the purse strings, that this is a good investment. And, so far I've struggled. And this year, there is a focus from the president on student retention. So I'm wondering if anyone that is in the room that uses impact has a story that they could share about how impact could directly be tied to student retention efforts. Somebody behind you is gonna answer.
Oh, I she's gonna ask a question. Oh, you also Perfect. Perfect. So we started using impact to not only target student retention, but to also, help students navigate canvas. And so one of the main things was to reach out to students who may be struggling in their online courses or in Canvas, and that was to, because we're a really small institution.
We don't have support. We only have seven hundred full time students. And so that's like really small and we don't have all the departments that can support our students. So we figured, impact would be a really nice tool to support them with technical questions, but also to reach out as far as advisors They'll reach out and use the impact tool to be able to say, Hey, I know you're struggling, reach out to me. I can help you.
These are my hours. And so we have students that didn't even know that they had a low score. And, it was a surprise to them that they were failing. So, A lot of it really has to do with also faculty making sure they enter grades. So that's a whole different, problem.
But yeah, that's how we used it to try to reach our students specifically our online students that don't come to campus because there's somewhere else But I have a question is I heard at another conference at another session that faculty are now able to use impact in their courses? The report. Course reports Do you want me to? Oh, okay. Course reports, LTI tool is available for faculty, and you can submit support ticket ticket that turned on, but that would enable the faculty and to see the tool adoption report inside their course. So they can see how the course content is being utilized, any third party tools that are being utilized by students, and it's gonna give them that report, but just for that course that they're in. Okay.
So they cannot create They cannot create messages. You could, in theory, invite them. Highly recommend not doing that. You'd, you'd open Canvas to a firework display of messages, I suppose, but, the reporting is available for faculty. Course reports LTI tool, I'm coming.
So sorry. That's one two three. Yeah. Hi. I'm from the California community college system.
Hi. How are you? It's good to see you. I've been, you know, trying to answer that question too as how do I get where we have money to that pace for Canvas for all of our schools, for our hundred and fifteen colleges. And, we went to the ledge analyst's office to get that money. So it comes from the legislature.
So I've been trying to okay. How are we gonna make sure that they keep paying for that? Well, in California, What what are we known for? Not Sunshine anymore. We're known for we're known for fires. We're known for floods. We're known for closures.
We're going for, you know, and it happens like that. And, so I've been thinking if we could put in there that canvassing only system all the schools use that we could use it as a disaster announcement space where if every student and every faculty member and every administrator and we're unlimited, has, an account, then we could send them messages, when things like that happen about where to go and where to look and we'd like information back from them. So we'd like to, you know, put in, and I think we could probably easily do a, you know, form that they have to sit back. But when, Santa Rosa went down for, what, was it, ten days? I think they were down they didn't know where their faculty were. They didn't know if their faculty had their homes.
It was due to a fire. They didn't know where their students were. They had to send out something. If we could let everybody know, Canvas is the place to look. Yep.
And and we had canned messages ready to go out that the administrators held off until they needed something like that. I think the legislature would continue to fund based on that because California is big on how do we deal with disasters? So, not right. So disaster recovery Absolutely. So I'm sure Melissa wants to chime in here, but we have an institution in Florida who used impact exactly for that during hurricane. Right? It was so helpful for them to really reach out to those students who were affected, folks who needed to maybe turn in things later.
Exact same use case when it comes to natural disasters. So it's been done somewhere. Yes. And we're happy to, follow-up with you on that. Yeah.
Hi. I got I got two, but first one's really quick. You mentioned the insights for the for the mobile data. Is that strictly with the Canvas app, or does that include mobile web? Mobile apps, I believe. Just the apps.
Mobile web browser does Tup browser are included in the tool adoption report, but we also have additional reporting on the Canvas mobile app for teachers and students. The new mobile data is specifically about mobile app data. Gotcha. Okay. And then I saw something on one of the slides about support tickets through impact or something.
Can can you explain a little bit more about that? This was particularly in Blackboard when we didn't have Canvas twenty four by seven support. At the bottom, when people went to the impact said I need more information on something at the bottom. We literally had where they could, enter a support ticket, or they could immediately click on a zoom room where we support faculty, or they could send an email. In other words, at the bottom, we actually listed their support options so that was actionable. One thing great about impact with the support when they click on the icon and click on, like, support and email support is that the URL of where the faculty in the specifically in that course, get automatically added into it with additional information.
So no more of going back and forth what course is it? Which what section is it? It's right there where someone could just click on it and look at it. I think we have one last question. I know Andy's had his hand up for a little while. Do two more? I think we're at five. So I wanna make sure people have time to get to the last session of the day.
Yep. So the question was, is there an ability to use impact in other systems outside Canvas? Not today, but we should absolutely talk about that. And I that's some of the conversations we were hearing earlier this week, right, as we think about other partner tools, etcetera. Looks like we're out of time really appreciate everyone coming, and we have so many resources. If you wanna follow-up with us, definitely come to the booth, and hope you all enjoy tonight.
Some new product updates that we're excited to share, but really wanna spend the majority of our time, right, hearing from our special guests, what's worked for them, some success stories, and maybe some takeaways y'all can take. Away from Instructure Con. So, like I mentioned, you know, before we get started, first of all, I know it's the end of the day. It's been a very long day. There's a lot of information coming at you, but I hope that it's been really rich and helpful as you think about what to take back to all of your institutions.
We're gonna cover again how pact helps institutions who are using solutions within the within the Instructure Learning platform, product updates, and again, just a little bit hearing about, you know, how these two have implemented impact within their institutions. So we've been talking a lot about the plat form. Right? And impact embodies just that, that platform approach to measure the adoption and engagement and intervene across your teaching and learning systems. Impacts a way to empower all of your institutions to better manage courses, curriculum, and educator student interactions in a unified platform, providing everyone with a really seamless connected experience. So before we get started, we'd love to hear from all of you just get some a little little interactivity.
Right? And under and know what you would like to improve. And I think that this is not working. So maybe we have to skip that. Alright. Yeah.
We have it. Alright. Well, maybe we can shout some out. In your LMS adoption and engagement. Tool adoption.
Tool adoption. Quiz use? Just in time, help. That's a great one. Message students who. Message students who.
Another one. Alright. So before we dive in, by show of hands, how many people here are familiar with impact? How many are current customers? How many don't know anything about it? Alright. So we have a nice mix of folks. So you we all know that an LMS is very resource intensive.
It's a big investment that you all make And so what we wanna provide with impact is a way for you to understand insights on how your students and faculty are using Canvas, but more importantly, how you can set up targeted data driven interventions, as well as provide in app support. Something we've been talking a lot about, right, today is AI. Right? And as you all go back to your institutions, get ready for false start. It's a big topic that you're probably engaging within your institutions, and think of impact as a way where you can share resources, right, make sure that everyone understands how you wanna think about it, how you wanna leverage it within your institutions, provide that in app support These are just a couple of ways that impact can help you on a day to day basis. So I'm gonna talk through a couple of updates that we've made on the product side.
We've put a lot of emphasis in our platform approach over the past year. We've been investing in unifying our look and feel, ensuring that we provide better support and really giving you deeper insight into your ed tech. So we're gonna start with walk throughs, which is something we are really excited about. Walk those are essentially a step by step, guide, right, that you can give your users to instill best practices while providing a company in Compton. They're a great way to have another tool in your toolbox when it comes to LMS optimization.
And what's great about it is it really saves admin's time when it comes to supporting your faculty and students. We've seen some interesting use cases across institutions when it comes to best course design practices, tool rollouts, which is what I heard earlier, resource adoption, compliance campaigns, accessibility, student to student collaboration, so many different use cases. And we've also provided over thirty out of the box options, which enable you all to just leverage. Right? These are the top use cases that we've seen from tuitions and just start, you know, going right away. So you can see some of this here.
Hopefully, it loads. Oh, yay. It's working. This is an example of just that step by step adoption. Another use case we were talking about even earlier today in the k twelve session is new faculty onboarding.
Right? They need different support when they're coming on board. Their experience is different. They need to understand how to leverage canvas, how to implement it, and there's ways to really you know, walk them through step by step how they can, use it in in their courses. Okay. So the next update is mobile data.
We all know mobile is a huge component of canvas, right? And we're so excited to share that this data is now part of impact where you can utilize those insights to dive deeper into that usage across the campus student and teacher apps, both iOS and Android to understand what is happening, where are their areas to improve, across your faculty, students, parents? How can you better support them? And really kind of drive that adoption and engagement. User groups is something we're really excited about. I think we can all agree that we've got a lot of information coming at us every day, email, chat apps, notifications, lot of stuff. Right? And it's critical that as we think about how we support our users, we give them the most targeted information for what they need to do. And with user groups, admins can really customize audience segmentation and tailor that messaging so that you're sending the right information to the right student or or faculty member at the right time.
Some use cases that we've seen work really well here are creating targeted interventions to groups in a particular subaccount, or, you know, we can kind of create dynamic groups based on user activity, or if you've got CSV uploads, that's also supported. We wanna make sure that we can really be intentional about what we're sending each of our custom groups. So subaccount access is another enhancement that really extends the value and evangelizes what impact can do across your institution. Some institutions have teams of folks. Some institutions are a one person team.
And so what this allows is, someone to empower other folks within your in institution, to have that relevant access, to have that granular data, and be able to send, again, those target interventions for whatever they need to do. For example, you may have a hierarchical structure, right, within your institutions. You may need to understand specific usage within a particular school. And this enables each of those subaccount admins to target campaigns for those particular use cases. Later on Lim is actually gonna talk about how he uses a dead keyated subaccount in Canvas as a sandbox experience, for how CSU Long Beach gains insights.
So the other update we wanna talk about is campaigns redesigned. We also redesigned the insights, section, which I'll talk about in the next slide. And this is really all about creating a more cohesive user experience. We're leveraging Canvas InstUI, and just are starting to bring everything together into a really cohesive end to end, experience as we think about our platform approach. We've redesigned both of these sections for both user friendliness and accessibility, And there are some upgrades within both our campaigns and insights sections where, it's now more interactive.
It allows you to really understand the workflows from within the page. Start a campaign right from here. And on the insights section, there's an ability to really interact with these graphs. And download these, these files where prior, I think a lot of folks were struggling with just taking screenshots, being able to share those across your institutions. So I'd love to turn the conversation over to Kathy and Lim.
And before we get started, maybe each of you can introduce yourself your roles, how long you've been at your institutions, what you're accountable for. Kathy, do you wanna go first? Sure. Kathy Fernandez, academic technology officer at Chico State. I've been in the CSU for thirty five years. And, we bought impact back when it was easy soft at the, really, the beginning stages.
Hi. My name is Living Winn. I'm the LMS System admin, for the campus. I've been the university for twenty three years. We had, Blackboard, Beachboard, or what we call it, Bright Space.
But now we just go fully on Canvas right now. And, my team consists of, two SIS admin, including me, an LMS support and a technologist. Awesome. So Kathy, I'm gonna start with you. What initially drew you to impact? So especially post COVID, but even before COVID Chico stated had a discussion about, none of you have enough email.
Right? You all want more email and post COVID, especially faculty, and students ignoring emails because half of them maybe don't pertain to them or not just in time. So Chico State started talking about, you know, students need administrative emails. Like, hey, tuition is due or maybe something from the president. They have their activities. We're wildcats.
So, hey, what are the wild act wildcat activities in student clubs? What's going on there? And then they have their academics, why they came to Chico state. And therefore, we wanted to be able to pinpoint and focus the communications we needed specifically do the students or specifically do the faculty. And again, depending on their usage or where, you know, what their role is within the, LMS being able to target messages. Awesome. Lynn, what about you? It's not as cool as Kathy here, but basically, there's a mandate of pretty much us going to Canvas.
I was told that we're gonna switch it to Canvas early January of last year. And, oh, an impact is is included with that. My marvin right there is my director. Told us to, have it, told us in January to, hey, let's go with Canvas and were told to do it in spring, told him that you're crazy. So we went with summer.
But, once I start to, to start using Canvas, our impact. I think it's a tool that I don't know why we I don't think we could live without it anymore. Awesome. And obviously, I shared a lot of more tactical features within the product, but when we kind of talked a couple of weeks ago, we really talked about how to strategically set up your institutions, to not only implement impact, but leverage it, optimize it, and think about the entire life cycle of it. And so as you think about not just yourselves, but your teams, I'd love for each of you to share how you've structured your teams, how have you supported impact, and made it successful for each of your institutions.
So, originally, our LMS administrator was the one in charge of impact, but it became obvious in a couple different ways Chico State was really focused on student success. I'm sure you all are. And we decided that, you know, a new student steps into Chico State. They've got a technological environment that is well in the internet and bits and bytes. And so we started actually across my instructional designers talking about Hey, in week zero, we need the students to go to the portal.
We need them to know that they have access to Microsoft license. What are the key things in actually update zoom. That was a key thing. And then in the second semester, second week, maybe there was something else we need to do inform them. So we actually used a Google doc with a template that basically did the full life cycle.
Now when is registration? Okay. This is when we'll put something an impact about, Hey, did you go to your degree planner? Did you at where you're at? Are you prepared to next week, actually, you know, get into and register for classes? So then each semester, of course, changes a little bit because, well, spring semester or holidays don't fall on the same dates. So we're constantly juggling as new things come up like, hey, it's time devote. Again, we we're very careful about not wanting all of the university to go, Hey, now we have impact. No.
We wanna focus on the academic environment, but sometimes we do put in other messages. Yeah. I love that. And I love how you've kind of really scaffolded. Right? Things that you know to be common use cases as you go through semester.
Can you also talk a little bit about the advisory group you set up to make sure that you're really collaborating across your institution? Yeah. So we have an LMS Advisory group. Again, this includes, you know, obviously, the support desk, while my staff support the faculty, of course, the other side of the coin are the students. So Making sure that the student support was in there. We have the registrar in there.
We have the accessibility folks in there. So this LMS advisory meeting happens every week on a Wednesday talking about so what's happening now? What's been requested? What is changing? And of course, we can't all keep up with all the upgrades now that we're all in the cloud, those upgrades happen whenever they're gonna happen, and so trying to keep everybody on the same page. So we use also the LMS Advisory to say we will be popping up these messages next. Mhmm. Yeah.
I love the collaboration that you talked about and just making sure that you're hearing from everybody and you're on the same page in terms of what's the most important thing that we can be supporting our faculty and our students with. Lim, I'd love to hear from you. Yeah. So, again, we just we're kind of a late adopter, so that's the dream of what we're heading toward. But as soon as we got impact, we try to start rolling out and how fun and, you know, and, and start to doing that.
But then we realized that it's a it's a lot of stuff that you had to deal with. We kind of pull back a bit and start to build the infrastructure. We start with the LMS support, the LMS admin team to look through the LTI connection, the monitor, the template, making sure that that's connected, then then the LMS support team in our end review the article, turn off things that isn't, that applies to the universe such as, you know, Google's, we're a Microsoft shop. So you should turn that off. Add in more roles such as, you know, we have a librarian role that we add in.
And then connecting those articles straight to the, the, the the templates and information. So that way when a when a instructor would come into, like, go into the people tools and As soon as they click on the, the impact support page, it's right there tying that all in first. And then we have the or technologists who looks through the, the data and looking through the, what's, what's being used or not. We talked about, like, different colleges adopting different tools and stuff, but we had realized that the sandbox data can also be beneficial. You could see what's, instructor are testing and playing around with, match it up with instructor that's using it.
And that way when you have, like, these instructors testing it, but they're not using it. Let's have a little campaign of, introduction. Those are the one that's using it. Let's make it immediate, intermediate or advanced, training for them. So that's kinda like the stuff that once you do the subaccount structures, you could get a lot of data, and you could really utilize, different ways of, of, you know, utilizing it.
And I know you think about Kathy as the gold standard, but you've done so much to get impact off the ground in such a short period of time. How are you keeping all these different constituents and stakeholders in your institution on the same page? The Yeah. You. Lovely. Yeah.
So luckily, they're all under me. So I've, I have this whole vision And, and, and then I, you know, we have weekly meeting, stand ups, sprint meeting, specifically talking about, you know, how it works and how it doesn't work. Play around with it. And then, pretty much take, you know, pretty much, you know, get feedback. You know, they say, Hey, this is great.
This is working. This is better. I'm not the smartest person, so You know, always getting feedback because, you know, the tool is super powerful and there's so many ways to do it. And each university is just different. And we're to and each customer is different too.
So, you know, we're we're just all learning it together in this big, wonderful journey. Yeah. I'll say, you know, as the instructional designers are supporting the faculty, where are the issues coming up. And, again, it's a life cycle. Right? What starts at the beginning of the semester is course copy and publish your course.
What happens in the middle of the semester is more of the feedback, the discussion, the quizzes. And so just trying to move everybody along. They're not getting this. They are getting that and leveraging it that way. We had two examples where we used to be Proctorio campus wide, then it only went to one college.
So again, not spamming all of them, but speaking to the ones that need to be, you know, told what's being adopted or what's being taken away. And then also, McGraw Hill, all of a sudden, started with, the advantage, LTI. Well, again, don't bother all the faculty with that. Just go in with impact, find out those that are already using that particular LTI and send the update message to them. I like to add on to it because I get super excited about it.
One of the beneficial of pretty much impact is to, pretty much, targeting groups. So when you say, hey, you know, at the beginning of the semester, remind faculty to to publish it. Previously without impact, it's a big announcement. Hey, don't forget to do this. As more emails start coming, don't forget to do this.
Don't forget to do that. But professors like, I'm not an idiot. I know how to do this already while other isn't. With this, you could really target them like, Hey, you didn't do this. So we're targeting you.
And you could and for those advanced users, you could just leave them alone. Yep. I'm pointing at you. Yes. Some of the themes I'm picking up is an iterative approach, right? Because you may not know what works, but you can really learn from each of your campaigns.
It's kind of how we develop product. Right? We get feedback from all of you. We need you need that feedback cycle to understand what's working, what's not working, and how do you get better? In the LMS Advisory, we always go through the thumbs up and thumbs down. Okay? And then why did they do the thumbs up or the thumbs down? And so in finals week, we had said something about, you know, don't forget it's a good time to take a deep breath, take yourself for a walk, or whatever the case be. Well, you know, getting the thumbs up and saying, yeah, or those kinds of messages, which has nothing to do with technology, but just being aware of the environment, So that's been a beautiful thing to even be able to see the feedback and see where we need to improve.
And for those who don't know what that is and impact, what is the thumb and thumbs down. Okay. So when you put up a a message and it pops up, students and or faculty, depending on who you've sent the message to, can say, yep, that message was a good message for me, or nope, that message didn't apply, or you missed something. I don't understand, you know, you used an acronym. What does that mean? So in addition to just seeing like how your campaigns are even working, you're also getting feedback from your users around.
This was a great message, not so great. Yep. And next time, we're changing the message because this was confusing. Yep. Awesome.
Thank you for sharing. Alright. Next question. Where have you both seen the most success with impact? Well, again, getting that student feedback, what we've started to realize is freshmen being introduced to Chico State don't know the technology environment. So, of course, we need to let them know along the way all the technologies we want them to know about.
But by the time you're a junior, it's like I've seen that message a few times. So now it's starting to think about, well, okay, now do we need to start targeting differently? Based on what level, at the institution you've been. But I, you know, overall, we just keep falling back into leveraging impact in multiple ways. We we too are migrating to Canvas, so we actually had impact times too. Letting people know that they were coming off Blackboard, letting people on board to, impact.
So having both of that was very helpful for different messages. I know we have a visual here about what you spoke about earlier. Right? Really thinking about that life cycle, that week zero, what are the most important things? Week one, what are the most important things? Can you talk a little bit about these templates? And I know you have a very robust tracker -- Yeah. -- and system. Yeah.
So, again, in a Google doc, you know, this is what template looks like. And then in the Google doc, every single week, we just keep adding on week two, week three, week four. If we put in an image, of course, we want an tag, you know, what was the main reason why we decided to do this? When is it gonna pop up? When is it not gonna pop up anymore? So, again, it sets up the structure and the planning And if something pops up, let's say the second week that we're like, well, we're not gonna do that next week. Let's look out at the fifth week. We can start putting it into the Google doc and therefore plan going forward.
So we have for every single semester, a Google doc full of, again, what we've done. And then we also usually snapshot what was the actual message, because as you know, when you format, it may look very different than putting it in the Google Doc there was an and then the other thing we do is we take a lot of data out of impact. And on our campus, we have somebody who's very good at Power BI. So pretty much on a weekly to monthly basis, we are looking at all the tools integrations, you know, interesting seeing the learn platform how we're gonna be able to see the LTI tools there. But we actually have slides on every single tool and and, you know, when it was hot and, popular in the semester, and when it tapers off, so we use all of that data, but obviously through Power BI.
Awesome. Lynn, where have you seen the most success? I think the most success is pretty much, for me, the LTI data, the data itself. There's certain of tool, Respondus LockDown that you can't get data from the vendors. And so, Impact can do that. Read speakers, give you more information data.
But, understanding how, impacts gets the data, which is, you know, pretty much when they go on to and click on it, compare it to the vendor's data, and that will give you a good story of when are they clicking it, when they're actually using it. So that's been a really good, for me, it's the most important where you could actually further leverage the data itself of, of when, when, and where, and what time they're clicking. Awesome. Alright. I'm gonna go into any best practices.
And I think let's do this in a two part way. Right? So maybe thinking back into when you were first implementing impact and you were getting started. You know, what are some advice that you would wanna share? Well, again, I think I've demonstrated that landing is, you know, communications is really important, and we don't just like, okay, create that message, send it out. No. There's multiple people putting their eyes on it, multiple instructional designers.
Hey, you said it this way, but I think this might be a better way to say it. So it's not just impact. It's also preparing your communications, and no surprise these days being very succinct. So, of course, we try to keep everything into a bullet four format everybody to quickly look through. So, you know, best practice is it's not just about the tool.
It's making sure you're planned and ready to leverage the tool best way possible. Awesome, Lynn. I'm more of a conservative approach where, the best practice is start with looking at pretty much where the LCI connection is. And then, you know, build it from the back end to ground up. Because we kinda started, okay, this is great.
Let's do a campaign. And then it kinda gets like, okay, where are we targeting and and how it goes this. Because when you do a campaign, you wanna also give, you know, support articles and where it is and on that demand. So I would say start with, again, with, the whole team of the LTI, you know, looking through your LTI, verifying if everything is is getting that data. Review the sport articles because you don't want to have it where of faculty would see the support or go, but, oh, yeah, we did disable this for instructors, but yeah, it's available, like resetting, resetting courses.
So we actually had to hide that and recreate another one for ourselves. Stuff like that. So clean that up, but, and then start a whole campaign, which we're doing right now early this year. I'll add to that too. We are also trying to figure out, you know, documentation when faculty get started on something.
It's documentation, meaning I know you need to know from beginning to end about this tool versus a knowledge based article, which is I'm just looking for a particular answer So also trying to, based on communications, looking at the, is this documentation? Where should this really be? And then again, lining up And then as as we're noting, the technology keeps changing and trying to stay up with the documentation and the knowledge base art articles are challenging. Yep. Yeah. Let me talk to a lot about in our prior conversation around course evaluation. Yes.
Can you tell the audience a little bit about what you did there? So So I know that the biggest thing is, you know, students are not taking course evaluation. We've used to be, Scanron class climate shot. We've briefly just moved to call straight queue classroom. We enable all these where, cool tools But then, you know, when running to, LMS systems figuring out how to, to communicate to to students. Now, obviously, the the system itself, whether you're using class climate or q or quality evaluation, when someone creates an evaluation, it auto makes sense in emails to the student.
Great. Right? It shoots it out. You don't know if they're actually reading it, but it's out there. And then, then there's another option where we pretty much make an announcement to, to, in Canvas. You know, hey, here's a course of values.
Do it. Don't know, no input, no, it's nothing. And then we we also try and we did another step where we actually sent, each individual students a message within Canvas, where they can be, message in Canvas, say, hey, don't do you please do your course evaluation. Again, you don't get any feedback from that. You just send it out and just hope for the best.
But with with impacts, what's really nice about that is that we do, a pop ups, messaging to the students. So the first week, we send, you know, we get a list of students that haven't done their course evaluation. We put them into group together, send a nice, pop up message, and you could actually wait and see what's going on. Oh, they're actually looking at but they're they're not doing the course evaluation. Oh, they're doing course evaluation because they're clicking on it.
Within the after that week, we clear out the group. We added we we again take a n the group again, the the the one that haven't done their course evaluation. Those are the one that that does it already. Cool. You won't get this message.
But the one that don't will reset it and get you this message again. So and you could see the trend of like where they're looking at it, where they're not when they're clicking on it. And after like four or five, you know, we can tell it ends and it ends, and then we gathered the data and we looked at it, What's the great benefit about that is that we could tell people like, hey, student are seeing these information, student are seeing they'll pop up because it's in the data. You can't have that when you're sending emails. You should send an email.
Hope for the best. So the conversation starts to become like, not like how we delivering the message is why students are not taking the valuation. So that's been a huge benefit, and that's one of the high stake impact messages that we're, I think, is a big success on. Awesome. I could go on and on, but Alright.
Well, I'm thinking about the future. What are you most excited about when it comes to impact in the future? Well, I know my staff are very interested in the walk throughs and since we're still have six hundred faculty to join Canvas' fall. It's first things first. I forget whether you ask this question. So I'm gonna sort of flip it a little bit, is that because we are doing, so many of the messages, we would like to be able to copy and then edit messages.
And instead, we have to start fresh. So that is something that we are looking forward to. And we continue to engage with Melissa and the CSU so that we can continue together to leverage the case studies that we're talking about right now. Awesome. I agree.
Walk three is the best. Mainly for our our support teams. We have a lot of, every semester always the typical faculty that comes in asking the same question. Over and over, we could just target them and give them walk through. So I was like, here's a walk through.
So, the goal is to have lesson the list. And as, you know, as we figure out more of the common questions arises, whether this new faculty or or, new staff or anything else or students, we could target like, hey, new instructor. Here's a list, and let's target this because it's the most common question. So walkthrough would I'm really excited about it. Yeah.
The Is there data on walkthroughs? Recently released. Do you wanna Excellent. Because I can see how many times does that faculty walk through that. What step they fall off on? What step they fall off on? Oh, very good. Yeah.
The culture of kind of self-service and self direction is huge because you all have so much to do. Yeah. And just reducing that the load that comes at you and really empower others to seek the information themselves or even really walk them through step by step, right, how to get it. Is gonna be so critical because at the end of the day, right? Our mission is really to help save educators time, this is one way we can do that. And then you can continue to iterate and improve what you're seeing in your particular institutions to really hone in on where you can continue to provide that support.
Yep. You got it. Awesome. So maybe we can go around the room. I'm gonna steal one of these mics.
And understand where folks see impact where folks see impact being instrumental in their institution, and then we're happy to open it up to Q and A. So one of the things we ran into just last week was, we are during the summer, we roll out a lot of LTIs. And when they pop up on navigation, we really can't control it. So what we've done, is we're looking at when I see the tickets when an LTI is coming through But when ITS is going to actually add it to the to the navigation, we have resources in confluence ready. So if they hover, they see it.
So they don't call us and say, what is this? It stops that that call. So it but I love now I'm thinking because our biggest question at the beginning of semester is do I publish my course? And it's every semester on the first day class, it will publish. But if we had something of it where they went to go to try to publish and it said, Hey, this will happen So -- Don't worry. -- just gave me a little like, uh-huh. We could do that.
But it is about cutting down on on the work and and having them self serve. So I love that part. Yeah. Definitely. And we did have to change our wording.
We found that if we ever said remember to or did you remember or did you know we got the, yes, we knew. Do we need to, you know, so we did. We just left it as, you know, this is the first, you know, publisher course this this time or or do this and they didn't get offended. It was almost like we were offending them by saying, you did they didn't remember that. Well, you're already doing the content iteration based on what messaging is read as resident.
Yeah. On the feedback we get, Yeah. Anybody else? So, great talk. You know, I got so many ideas. I've already emailed you both.
But, one of the things to Liam's point was students taking action. So we have an annual IT survey. Faculty response rate great. Staff, response rate. Great.
Students, not so much. One of the things about it was they always ask, what is your preferred method of communication? And the university and my colleagues in IT always thought, email because the people that respond to the survey. Select email. So they asked, how do you distribute the survey? Oh, through email. Is it sent any other way? Nope.
Give me the list of people that haven't used or haven't responded. And let's see what we can do on, with impact. So we went from forty something response rate to ninety eight percent response rate. And immediately, it's demonstrating with, like, hard data. Look, within a week and a half, we went from forty something to ninety eight percent.
And the jump up into the ninety eight percentile was within forty eight hours. So it's like changing the perception because just as it is that every university, they're in love with their own words. So the short, very direct messaging is we're shifting that sort of we're gonna send this email and will bury the lead in the third, fourth paragraph. Now it's just putting it in their face, and we're getting actionable results on it. And you know when they say, emails by preference? Well, for what kind of message because there's a million kinds of messages.
So it's not the preference for every kind of message. And please don't nag me a hundred times, but then there are those that procrastinate that need the nag. Anybody else? So we're happy to open up to Q and A. Before we do that is folks raise their hands. Right? If you wanna find out more, there's a lot of information on our Canvas community.
There's impact universe. We've got an impact booth here. And, of course, our roadmap that's constantly updated. We do that on a quarterly basis. But we also update on a monthly basis with blog posts from our product managers.
So, yeah, we have questions. Okay. Yep. I already got the mic. Alright.
So, I have a cue that needs an a. It's, so can you talk a little bit about frequency of these different interventions that impact can provide. So we're new to Canvas, and therefore, we're new to impact. And we see a lot of potential, and we're excited about the things that we could do, but we also don't wanna become the people that are annoying the heck out of faculty and students. We also see that we have an opportunity to set kind of an expectation at this point by how many how frequently we do this.
But how did you all find the right frequency? Did you find a sweet spot? Did you settle into it right away? Did you get a lot of feedback from faculty saying this is too much? I like them. Give me more. Just kinda what what sort of experience did you have finding the right, that sweet spot? Well, what's really nice is, we send out that weekly success message I talked about, and we show students if you don't wanna see the we're gonna send it out weekly. So if you don't wanna see it for the rest of the week, then just say, what is it? I'm done at the bottom. Don't show again.
So in some sense, it's we will do it weekly and you get to choose whether it continues to pop up or not. Part of it is understanding the technology. We're still kinda like, figuring it out, but knowing that, okay, an email will send to their email box, and it's gonna be thrown in with a bunch of emails. Impact doesn't send email. It's a message when they log in to to, to Canvas.
So it's like if a week later a student logs in and boom, there it is. And you actually could see how many students, is clicking on it or seeing it and whether you want to turn it off at a certain time or not. It's really just depend on you and you kind of has player. The best part of it is that you could give enable feedback. You can give them a thumbs up.
Send a they'll send a message like, hey, this is great. This is not working. And and and you can adjust as needed. And you actually see the graph when they Yeah. So, I mean, I would think about it kinda like an AB testing tool in a way.
Right? Like, you're gonna try something out. You're gonna gonna see how it does. You're gonna maybe it's working, maybe it's not working, and you're gonna use that data in those graphs to say, how do I improve on this? Maybe it's too often. Maybe it's not enough. Got one more question back here, and then I'll start heading back up there.
So, the out of the box monitors, do you find that those were sufficient or did you have to create a whole bunch of to monitors to really get data on the pieces of information that you wanted to know. Not a lot, but I suggest to review it. Because I like to review things, and I do have to adjust certain things because it's not monitoring the way I want it. Out of the box is great because a good starting point. Review, I suggest reviewing, what's is really important, add on stuff that's also really important.
That is not there. It doesn't take too much time. Maybe, I think, maybe two or three weeks with a few, like, as you kind of work on and you see certain things missing. But, yeah, out of the box is great, but I will suggest to to review it just in case because they might not be monitoring just where you want it to be. Yeah.
I was gonna say same thing. In inevitably, it's, the feedback mechanism. It's just making your way, through those things, and making it some kind of routine for us, it's the LMS Advisory group. Yeah. So my question is more about getting support for purchasing the tool from upper leadership.
So I have been on a crusade for over a year, to try to convince my chain of command, the people that, operate the purse strings, that this is a good investment. And, so far I've struggled. And this year, there is a focus from the president on student retention. So I'm wondering if anyone that is in the room that uses impact has a story that they could share about how impact could directly be tied to student retention efforts. Somebody behind you is gonna answer.
Oh, I she's gonna ask a question. Oh, you also Perfect. Perfect. So we started using impact to not only target student retention, but to also, help students navigate canvas. And so one of the main things was to reach out to students who may be struggling in their online courses or in Canvas, and that was to, because we're a really small institution.
We don't have support. We only have seven hundred full time students. And so that's like really small and we don't have all the departments that can support our students. So we figured, impact would be a really nice tool to support them with technical questions, but also to reach out as far as advisors They'll reach out and use the impact tool to be able to say, Hey, I know you're struggling, reach out to me. I can help you.
These are my hours. And so we have students that didn't even know that they had a low score. And, it was a surprise to them that they were failing. So, A lot of it really has to do with also faculty making sure they enter grades. So that's a whole different, problem.
But yeah, that's how we used it to try to reach our students specifically our online students that don't come to campus because there's somewhere else But I have a question is I heard at another conference at another session that faculty are now able to use impact in their courses? The report. Course reports Do you want me to? Oh, okay. Course reports, LTI tool is available for faculty, and you can submit support ticket ticket that turned on, but that would enable the faculty and to see the tool adoption report inside their course. So they can see how the course content is being utilized, any third party tools that are being utilized by students, and it's gonna give them that report, but just for that course that they're in. Okay.
So they cannot create They cannot create messages. You could, in theory, invite them. Highly recommend not doing that. You'd, you'd open Canvas to a firework display of messages, I suppose, but, the reporting is available for faculty. Course reports LTI tool, I'm coming.
So sorry. That's one two three. Yeah. Hi. I'm from the California community college system.
Hi. How are you? It's good to see you. I've been, you know, trying to answer that question too as how do I get where we have money to that pace for Canvas for all of our schools, for our hundred and fifteen colleges. And, we went to the ledge analyst's office to get that money. So it comes from the legislature.
So I've been trying to okay. How are we gonna make sure that they keep paying for that? Well, in California, What what are we known for? Not Sunshine anymore. We're known for we're known for fires. We're known for floods. We're known for closures.
We're going for, you know, and it happens like that. And, so I've been thinking if we could put in there that canvassing only system all the schools use that we could use it as a disaster announcement space where if every student and every faculty member and every administrator and we're unlimited, has, an account, then we could send them messages, when things like that happen about where to go and where to look and we'd like information back from them. So we'd like to, you know, put in, and I think we could probably easily do a, you know, form that they have to sit back. But when, Santa Rosa went down for, what, was it, ten days? I think they were down they didn't know where their faculty were. They didn't know if their faculty had their homes.
It was due to a fire. They didn't know where their students were. They had to send out something. If we could let everybody know, Canvas is the place to look. Yep.
And and we had canned messages ready to go out that the administrators held off until they needed something like that. I think the legislature would continue to fund based on that because California is big on how do we deal with disasters? So, not right. So disaster recovery Absolutely. So I'm sure Melissa wants to chime in here, but we have an institution in Florida who used impact exactly for that during hurricane. Right? It was so helpful for them to really reach out to those students who were affected, folks who needed to maybe turn in things later.
Exact same use case when it comes to natural disasters. So it's been done somewhere. Yes. And we're happy to, follow-up with you on that. Yeah.
Hi. I got I got two, but first one's really quick. You mentioned the insights for the for the mobile data. Is that strictly with the Canvas app, or does that include mobile web? Mobile apps, I believe. Just the apps.
Mobile web browser does Tup browser are included in the tool adoption report, but we also have additional reporting on the Canvas mobile app for teachers and students. The new mobile data is specifically about mobile app data. Gotcha. Okay. And then I saw something on one of the slides about support tickets through impact or something.
Can can you explain a little bit more about that? This was particularly in Blackboard when we didn't have Canvas twenty four by seven support. At the bottom, when people went to the impact said I need more information on something at the bottom. We literally had where they could, enter a support ticket, or they could immediately click on a zoom room where we support faculty, or they could send an email. In other words, at the bottom, we actually listed their support options so that was actionable. One thing great about impact with the support when they click on the icon and click on, like, support and email support is that the URL of where the faculty in the specifically in that course, get automatically added into it with additional information.
So no more of going back and forth what course is it? Which what section is it? It's right there where someone could just click on it and look at it. I think we have one last question. I know Andy's had his hand up for a little while. Do two more? I think we're at five. So I wanna make sure people have time to get to the last session of the day.
Yep. So the question was, is there an ability to use impact in other systems outside Canvas? Not today, but we should absolutely talk about that. And I that's some of the conversations we were hearing earlier this week, right, as we think about other partner tools, etcetera. Looks like we're out of time really appreciate everyone coming, and we have so many resources. If you wanna follow-up with us, definitely come to the booth, and hope you all enjoy tonight.