Higher Ed's Moneyball? | KERA News

Higher Ed's Moneyball?

Oct 14, 2015
Originally published on October 15, 2015 1:44 pm

Our Ideas series is exploring innovation in education.

It's 20-year-old Randall Lofton's third shot at college. He's already wiped out twice. Too much partying and basketball, he says, and not enough studying. "I didn't apply myself."

Lofton is now trying to balance a full-time job with three classes at community college. He's taking a mix of online and in-class work at Valencia College in Orlando, Fla.

"So this is pretty much my last chance," he says. "This is something that I want to do, so I'm gonna work my heart off."

So far, he is. Lofton recently aced an online introductory composition class. One small thing that may have proved a big help: His professor sent several personalized messages of support. Lofton even keeps one email from his English professor, Neal Phillips, saved on his tablet.

"I screen-shot it and I saved it," Lofton says. "And he was basically saying, like, 'Don't quit, you're very hardworking in this class. The course is almost over; I appreciate your participation. I appreciate how you're very diligent and very intrigued by the work.' That touched me that somebody was paying attention. And I'm not just in somebody's class just as a name. That was cool."

The email from Phillips showed genuine care from an engaged professor. It was also, perhaps unbeknownst to Lofton, part of the community college's strategy to marry data science with interventions to improve student performance.

Call it higher ed's version of Moneyball. Only the goal isn't a World Series ring; it's to help more students stick with college, improve academically and graduate.

Fast analysis of disparate data streams, including your daily Web surfing, helps corporate America market its goods, chart growth and follow you across the Internet with annoying ads. Innovative predictive analytics are essential for businesses, especially tech companies. They've got annual conferences on the stuff.

So why aren't more of the best minds in higher education doing more to tap those data streams to improve teaching and learning?

Yes, colleges and universities have long used data to help shape policy.

But too often, critics say, the approach is retro — looking at performance data in spreadsheets that administrators funnel into sparsely read "best practices" reports for faculty. Or the information is kept in silos and used for alumni fundraising, marketing or for preparing reports for the board of directors.

It is, in effect, academic autopsy data. The information rarely has anything to do with helping improve student learning in real time.

Now, more schools such as Valencia College are dipping their toes deeper into the streams of what some have dubbed predictive and learning analytics.

Yep, more annoying ed-tech buzzwords. Basically it means big data goes to college, as software and digital platforms collect and sort academic data that teachers can then use quickly as an intervention strategy. The data collected include how engaged a student is online with course material, with discussion forums, and information on his or her academic background and other data points.

The goal is to use data science to improve learning, boost completion rates and help teachers and counselors better target academic interventions fast, with a compelling nudge, counseling or other outreach.

"It's our mission to democratize data," says Mark Milliron, co-founder and chief learning officer with the higher ed software company Civitas Learning, a leader in this field. "And to to get that data to people who need it most — the faculty, students and advisers." There are others doing similar work including Civitas competitors Starfish and Blackboard.

Valencia College is currently piloting evidence-based data-analysis tools by Civitas aimed at helping boost student engagement and performance.

It's early in the fall semester, but Phillips already sees danger signs for a handful of students in his online Intro to English Composition class. Some students haven't logged in lately or seem academically adrift.

And so, on a recent afternoon, he's at a computer on campus, crafting an email blast to students on his class roster who have a red frowny-face circle next to their name.

"Dear so and so. I don't like to say 'dear.' So I'm gonna put instead YO!" he says as he taps away at his keyboard.

He wants to reach out to them before it's too late. The emails will land in inboxes looking personalized to each student. And they are — sort of.

"Your ole professor Phillips here," he continues writing.

He opts for the more personalized "I care" tack over the vaguely creepy, "I'm watching your online activity" approach.

"I wanted to know if there's anything additional I could do to assist you in the course," he writes to half a dozen red-flagged students.

These introductory or "gateway" courses are hugely important for Valencia, as they are at many other community colleges. National and Valencia figures show that if students withdraw from or fail even one of their first five course attempts, their chance of graduating is cut in half. Fail or withdraw from two classes, and those chances are cut in half again.

But fast, early interventions might save them. "We want to help them get there as much as possible," Philips says, "because, yeah, the data is not good if they don't do well on the first try."

To help intervene, he's using software and a learning platform called Illume and an app called Inspire. Both are from Civitas.

Here's how it works: The system vacuums up as much data as possible on things such as student participation online in assignments and discussion boards, how often and how long a student logs in to the school's learning platform, and data on a student's academic background. It's refreshed four times a day to create a student "engagement score," among other data points.

"It's unique because it's not just grade data or did they reply to something. It's a more holistic view of the student," says Valencia mathematics professor Brian Macon. "I don't think I'd want to teach without it now that I've had it for a year."

Of course, professors have long had the ability to send a pep talk email or try to motivate and engage students with the right words after class or during office hours.

But the difference now, says Kurt Ewen, a senior administrator at Valencia, is that real-time feedback allows teachers to more quickly flag a student who's struggling and, perhaps, better pinpoint what types of interventions might be needed.

"Part of what this tool allows for us to do is to shorten the amount of time that we have to wait to see where a student is," Ewen says. "Now they can do it in a way that they don't have to wait until after midterm."

The tools also can gather and analyze data from college or university learning-management and student-data systems, among other streams. That, for example, can tell a school exactly what its GPA tipping-point for student success or failure is, or whether grades are more predictive of completion than SAT or ACT scores.

"We help the institutions, especially the faculty and advisers, turn the lights on bright so they can see what's happening and use the best of their professional skill and will to change the trajectory for that student," Milliron says. The four-year-old company recently got new investor pledges of some $60 million to expand its products.

At Valencia and other schools using predictive analytics, a semi-personalized email is just one intervention. Others might include one-on-one or group tutoring, peer-to-peer mentoring, meetings with an adviser or professor or other steps.

The job of intervening is made that much more challenging by the fact that Valencia serves more than 70,000 students in two sprawling central Florida counties. Many students have to balance school with full-time jobs, kids and other responsibilities.

Here's another reason using data for early intervention matters: Studies show that nearly 80 percent of first-year community college students need at least some remedial English or math help.

But Florida was tip of the spear in a national backlash against what many saw as ineffectual remedial education. Students at public universities in Florida are no longer required to take remedial tests or classes. It's now their choice.

So now some introductory courses act as de facto remedial classes. Students in Phillips' composition class will have to show they can handle college-level work and craft cogent arguments within well-framed essays. "They have to have minimum competencies," Phillips says. "They have to do so much writing. They have to follow through on the tasks."

No one involved in Valencia's pilot project sees these new digital platforms as silver bullets. Civitas' Milliron readily concedes the best data systems in the world "will not fix a student who is not on purpose, who is not willing to engage and doesn't have the tenacity and motivation to succeed in higher education."

His company's tools do help, he believes, those students who might be really trying hard but just aren't connecting with the material or who are stuck and just don't know whom to talk to.

Civitas says its numbers from the dozens of schools it's working with have consistently shown a boost of 3 to 7 percent in course completion and "persistence," meaning continued enrollment.

And Civitas is betting that helping improve retention rates will prove profitable. As the company's chief executive, Charles Thornburgh, has said: "Approximately $100 billion in tuition and fees are spent each year [in the U.S.] on students who will not graduate. We believe there is an opportunity to improve that number by 5 to 10 percent, which is a multibillion-dollar opportunity."

As for Valencia, it's not yet clear whether the added data and interventions are helping boost student performance or graduation rates. "It is still early to determine the impact of the analytic tools," Ewen says.

Nonetheless, Valencia professors and administrators are cautiously optimistic.

"It has the potential to be innovative depending upon the people who use it," Ewen tells me. "We believe that predictive analytics has the potential to take us to a place we haven't been before and as an enhancement to the work we've been doing already."

For student Lofton, all the nudges helped push him to participate and thrive. He got an A in Phillips' class.

"We felt like the essays were, like, so moving and touching, we was like, 'Man, we gotta discuss this!' " he says. "The course was interesting. The extra credit [for online participation] to me was just a bonus." Students should give it their all, he says, especially if a professor such as Phillips "is going all out as far as trying to help the kids pass."

Copyright 2015 NPR. To see more, visit http://www.npr.org/.

Transcript

AUDIE CORNISH, HOST:

Colleges and universities use data all the time to track enrollment and graduation rates to sell their school. Now they're using software to track how engaged students are online with course material and with each other. It's called learning analytics. NPR's Eric Westervelt sent this report from one of Florida's largest community colleges. It's part of our series on innovation in education.

ERIC WESTERVELT, BYLINE: Valencia Community College professor Neal Phillips is at a campus computer in Orlando, Fla., crafting an email blast.

NEAL PHILLIPS: You know, dear so-and-so - I don't like to say dear. I'm going to put instead yo.

WESTERVELT: The emails will look personalized, but they're not quite.

PHILLIPS: Your ole professor Phillips here.

WESTERVELT: Phillips is sending the emails to students with bright red frowny-face circles next to their names on his computer screen. It's early in the fall semester, but Phillips already sees danger signs for those students in his online Intro to English Composition class, students who haven't logged in lately or who seem to be drifting. So Phillips wants to reach out before it's too late, and how he reaches out matters. The slightly creepy I-see-you-haven't-logged-in type emails don't work. He opts for the more personalized I care approach.

PHILLIPS: I wanted to know if there was anything additional I could do...

WESTERVELT: National and Florida data show that nearly 80 percent of first-year community college students need at least some remedial help. But Florida no longer requires remedial testing in classes. It's a student's choice. So for Valencia Community College, these online gateway courses are hugely important. Students will have to demonstrate they can craft cogent arguments within well-framed essays to prove they're ready for college-level work.

PHILLIPS: They have got to have minimum competencies. They have to do so much writing. They have to follow through on the tasks.

WESTERVELT: And real-time intervention matters. Mirroring national community college numbers, Valencia's figures show that if students withdraw or fail even one of their first five course attempts, their chance of graduating is cut in half. But with early interventions, they might make it.

PHILLIPS: And we want to help them get there as much as possible because, yeah, the data's not good if they don't do well on the first try.

WESTERVELT: To intervene, professor Phillips is using a higher-ed software platform called Illume and an app called Inspire for Teachers, both by the ed tech company Civitas Learning. Here's how it works. The system vacuums up as much data as possible on things like student participation online in assignments, discussion boards and more, as well as how often and how long a student logs in and data on a student's academic background. The data's refreshed four times a day. Of course, professors have long had the ability to send a pep talk email or try to motivate students after class or during office hours. But the difference now is that real-time feedback allows teachers to quickly flag a student who's struggling, says Valencia College administrator Kurt Ewen.

KURT EWEN: Part of what this tool allows for us to do is to shorten the amount of time that we have to wait to see where a student is. Now they can do it in a way that they're not waiting until after midterm.

WESTERVELT: And an email is only one intervention. Others include one-on-one or group tutoring or a call from an advisor or the professor. The job of intervening is made that much more challenging by the fact that Valencia serves more than 70,000 students in two sprawling Central Florida counties. Many students have to balance school with full-time jobs, kids and other responsibilities.

RANDALL LOFTON: Randall Lofton, 20 years old. We are at the Boys and Girls Club of Central Florida.

WESTERVELT: Lofton is working to balance a full-time job here with three college classes. He already wiped out of two other colleges. Too much partying and basketball, he says, and not enough focus on work. Valencia is his third try.

LOFTON: Didn't apply myself, so this is pretty much my last chance. This is something that I want to do, so I'm going to work my heart off.

WESTERVELT: He just took professor Phillips's class and says having his teacher regularly send a message he cares was in fact really huge. Lofton says he keeps one email for inspiration.

LOFTON: I screenshot it, and I saved it. I put it, like, in a little folder. It was saying, like, don't quit. You're very hard-working in this class. The course is almost over. He was like, I appreciate your participation. I appreciate how you're very diligent and you're very intrigued by the work. That touched me that actually, like, somebody's paying attention and I'm not just in somebody's class, like, just as a name. That was cool.

WESTERVELT: At Valencia, this is a pilot project. It's simply too soon to know whether these new learning analytics tools have done much to boost student performance or graduation rates. But Civitas Learning, which created these tools, says the colleges that have used them consistently have seen a 3 to 7 percent boost in course completion. Valencia College's Kurt Ewen is cautiously optimistic.

EWEN: It has the potential to be innovative depending upon the people who use it. We believe that predictive analytics has the potential to take us to a place we haven't been before.

WESTERVELT: For student Randall Lofton, all the nudges and incentives to earn extra credit for participating did help. He got an A in Phillips' class.

LOFTON: We felt like the essays was so, like, moving and touching. It was like, man, we got to, like, we got to discuss this. The extra credit, to me, was just a bonus. The questions were interesting. And I feel like if a professor is going all-out as far as trying to help the kids pass, you should give him, like, 200 percent, no problem.

WESTERVELT: Eric Westervelt, NPR News, Orlando. Transcript provided by NPR, Copyright NPR.