New software writes closed-captioning for videos
by Chase Carter, Senior Staff Writer
Editor: We've been following the progress of speecg recognition
software for several years and are starting to see commercial
applications for it (e.g. CapTel phone). We now learn that a developer
at Oklahoma State University has released an automatic video captioning
system that provides 80% accuracy without speaker-specific training.
That's not good enough for prime time, but certainly a huge step towards
a commercial application.
Here's the article from the Daily O'Collegian. It is republished with
their kind permission.
The Institute of Teaching and Learning Excellence at OSU has
developed the first automated closed-captioning software to help the
"There's no other school or company or anybody that has
something like this," said Wade Price, manager of merging
technologies at ITLE and the developer of the software.
One of ITLE's purposes is to serve professors' technology needs -
from Pow erPoint presentations to recording lectures.
Videos posted on ITLE's Web site for distance learning will be
closed-captioned for the handicapped and hearing impaired.
"Because we help teachers get their videos on the Internet, ITLE
had a need to stay compliant with the laws," Price said. "Part
of those laws say when you post a video on the Internet, it needs to be
In the past, the closed-captioning process had to be done manually
with a live person transcribing the video.
The process could take hours and ITLE did not have the manpower to
transcribe every video it posted on its Web site, Wade said.
The new software is about 80 percent accurate in translating audible
words to text. The process is about twice as long as the video it
transcribes and is fully automated.
"It's exciting to me for those that are impaired," Price
said. "Although you might argue that they're getting transcripts
that are only 80 percen t accurate, it's going to be so much easier to
caption videos. So many more videos are going to be captioned that
wouldn't be otherwise."
Price wrote the software from scratch in his free time and plans to
let OSU use it at no cost.
He said he hopes to market the software to a larger audience as it is
"The software is pretty amazing," Price said. "It puts
OSU at the forefront and gives hope to those other entities that may
need some captioning solutions."
ITLE works directly with OSU Student Disability Services to provide
closed-captioned video to any student who needs it.
To achieve a more accurate caption, ITLE plans to send out the
transcribed text to individual departments for professors to edit and
refine - all in the hopes of benefiting the student.
"We've worked on this in one way or another for a couple of
years now," said Kevin Sesock, assistant technology specialist with
Student Disability S ervices.
"In many ways, we are blazing some trails."
Sesock is in charge of coordinating transcribed lectures from ITLE to
professors and back again with revisions.
He said since the program is in its infancy, it is unknown how the
faculty will receive it. Because of the further-reaching implications of
the software, he doesn't foresee that as a problem.
"It may grow so fast that we need to invest some more resources
into it," Sesock said. "We can make content searchable so a
video can be searchable by students who want to find specific sections
of what was delivered via lecture. That's very helpful for someone
studying for a test as well as providing accommodations to
Sesock said he hopes students and faculty will embrace the new
program since it will help not only those with hearing impairments but
also other students - a theme carried throughout Student Disability
"We're continuing to try to make that distinction that what
we're doing, and the things that we're pushing for help everyone,"
Sandra Busby, the deaf and hard of hearing specialist for University
Counseling Services, said it's a program she's been pushing since she
arrived at OSU in 2004.
"We get complaints every semester from deaf and hard of hearing
individuals that say the online material needs captions," Busby
While many professors are cognizant of their students and supply
closed-captioned films, she said others are not as flexible and don't
wish to change their teaching formats to accommodate one student.
"If a film isn't closed captioned, the student has to decide
whether to look at the images, the interpreter or his notepad if he's
taking notes," Busby said. "It's a big circus trying to figure
out which information is more important."
With this program, Busby, Price and Sesock said they hope OSU will
become more accessible to not only the deaf and hard of hearing but also
all students on campus with disabilities.
"A deaf person should have the same access to materials a
hearing person has," Busby said.
Copyright 2007 The Daily O'Collegian