And sometimes…

Speech-to-text gets it so wrong it’s actually hilarious. And not, you know, a waste of your time and money.

Computer transcription misleads even as it impresses

computer_failure_01

With speech-to-text transcription, what are you really saving?

[Patrick Emond contributed to this post]

Last week, IBM trumpeted  their latest achievement in automated speech-to-text: a record-low error rate of 5.5 percent. But always, especially with regard to saving money on transcription, you have to read the fine print.

“This was measured on a very difficult speech recognition task: recorded conversations between humans discussing day-to-day topics like ‘buying a car,’” notes the Principal Research Scientist, George Saon. “This recorded corpus [defined as “a collection of written or spoken material in machine-readable form, assembled for the purpose of studying linguistic structures, frequencies, etc.”], known as the Switchboard corpus, has been used for over two decades to benchmark speech recognition systems.”

It is worth noting, however, that our “corpus” is not a mere database of recorded phone conversations, but the real world. Our team of transcription experts includes musicians, writers, bartenders, astrophysicists, ethnomusicologists, film geeks, hockey nuts, and world travelers, all of whom bring real-life experience and a unique knowledge base to your transcription projects.

Saon prefaces this entire milestone with the following claim, “Depending on who you ask, humans miss one or two out of every 20 words that they hear.” It is worth dwelling on that one claim for a moment. We are to believe that humans, when straining to listen or transcribe as this context dictates, miss 5 to 10 percent of everything that they hear? Saon, though, then goes on to explain the realities of speech-to-text:

“As part of our process in reaching today’s milestone, we determined human parity is actually lower than what anyone has yet achieved — at 5.1 percent.

“To determine this number, we worked to reproduce human-level results with the help of our partner , which provides speech and search technology services. And while our breakthrough of 5.5 percent is a big one, this discovery of human parity at 5.1 percent proved to us we have a way to go before we can claim technology is on par with humans.”

IBM tell us that they “worked to reproduce human-level results,” whereas we actually deliver them. An error rate of 5.1 percent, the utterly ludicrous benchmark by which IBM has set its speech-to-text goals, is an error every 20 words. This translates to an error on every single line of your transcript, with hundreds, if not thousands, of errors in total across, for example, a 35-page transcript (or one-hour recording).

We deliver transcripts well in excess of 99 percent accuracy with a 100 percent satisfaction guarantee. We are not looking to set any benchmarks; we want to deliver the best transcripts with the fastest turnaround. You don’t want to spend your time and money making hundreds or thousands of corrections; you want to grow your business. You want accurate transcripts.

And that is why we are here, and have been for 50 years. Computer speech-to-text programs may deliver a number, based on a benchmark, based on a corpus, based on a reproduction of a finite number of phone recordings. But the Audio Transcription Center just delivers: near-perfect transcription with no hidden fees when you need it.

Commas can make or break transcription (or the case of the $10 million comma)

reclining-oakie
Oakie, Oakhurst’s loveable mascot, seen here seemingly succumbing to exhaustion with a world-weary smile and an absent gaze. Unknown whether overtime was  a factor.

In which we ponder how an antiquated Maine labor law, a class-action lawsuit, and a controversial bit of punctuation can make the national news.

Recently, my wife forwarded me a New York Times article about a lawsuit in my home state of Maine. This isn’t a common occurrence, for how often does one really lend much thought to labor disputes in their hometown? But this one had a special flavor to it, that speaks to the risk inherent in subpar transcription.

The article, by Daniel Victor,  “Lack of Oxford Comma Could Cost Maine Company Millions in Overtime Dispute,” presents a somewhat worst-case-scenario for the Oxford comma (or serial comma of you’re not prone to well-ripened narcissism).

Three truck drivers are suing Oakhurst Dairy for more than four years’ worth of unpaid overtime. The state’s overtime rules indicate that any work performed after 40 hours in one week, must be paid out at 1.5 times the normal rate. There are of course exceptions, and the lawsuit, and the $10 million at stake, hinges upon one missing Oxford comma.

An explanation of the Oxford comma (from Oxford Dictionaries no less) for those curious.

In effect, the Oxford rule states that a comma should precede the conjunction in the final list item. To use a common example of when the Oxford comma might be prudent:

Oxford comma: I would like to thank my parents, Oprah, and the Pope.

No Oxford comma: I would like thank my parents, Oprah and the Pope.

So you may be asking: how exactly could a punctuation decision in the Maine Legislative Drafting Manual possibly affect the transcription for my project?

To be brief: Transcription is a subjective interpretation of a recorded medium. You are asking someone to write down not only what was said from a recorded file, but you are asking them to punctuate the content precisely.

Does your transcriptionist understand the Oxford comma? The comma splice? Does your transcriptionist understand that people don’t speak grammatically with any regularity and how best should they approach applying grammar in an interview when it is not regularly utilized?

These are all important questions you should consider when looking for transcription, and they only scratch the surface. Who do you trust with your transcription?

It turns out, if you’re following the curious case of the Oxford comma, the US Appeals Court sided with the plaintiffs in their decision. In short, as law reads:

The canning, processing, preserving, freezing, drying, marketing, storing, packing for shipment or distribution of:

(1) Agricultural produce;

(2) Meat and fish products; and

(3) Perishable foods.

And as Victor points out:

If there were a comma after “shipment,” it might have been clear that the law exempted the distribution of perishable foods. But the appeals court on Monday sided with the drivers, saying the absence of a comma produced enough uncertainty to rule in their favor. It reversed a lower court decision.

In other words: Oxford comma defenders won this round.

These little issues in a transcript can add up to confuse, obscure, or otherwise completely change the meaning and intent of an audio or video file. While it is unlikely that such an error will potentially result in the loss of millions with your case trending on The New York Times, it can result in subtly, or even wildly, inaccurate transcripts.

Which rather defeats the purpose, doesn’t it.

Rain, sleet, or "Snowpocalypse," ATC is here for all your transcription needs!

snowyboston

Winter Storm Juno or “Snowpocalypse” is arriving in the northeast with a vengeance overnight tonight, so we’re preparing for the worst while still handling all of your transcription needs to the best of our abilities!

Team ATC is ready to make sure your audio and video content aren’t buried beneath the snowdrifts or blown away in the 50+ mph blizzard-like winds.

If you have a RUSH need today, call (617) 423 – 2151 with any needs as early as possible to make sure we can sneak in a project before we leave today!

Thanks to the latest advances in weather forecasting and the Internet, our team is able to “virtually” keep your projects moving (for those projects that allow such work to leave the cozy confines of our downtown Boston World Headquarters).

ATC’s Boston office will remain open TODAY, Monday, January 26, 2015 until 5 p.m. EST (unless we follow up later that we needed to shut down early),  but tomorrow (and possibly Wednesday – I really hope not) we need to wait and see if the weather allows us to make it in.

We’ll be available virtually via email production@audiotranscriptioncenter.com. 

Our virtual team will be able to keep your important projects moving, and we’ll email them back to you as we’re able.

For those of you in the blizzard’s path, please stay safe, and we will post any updates here to the blog as needed.

ATC’S CLIENT SPOTLIGHT

 tc_book

AUGUST 2013

Tamar Carroll researches the questions of what motivates community activists to do what they do…

carroll-tamar-005

The media content our academically-minded transcription know-it-alls listen to and transcribe on a daily basis is truly second to noneOK, maybe we’re a little biased about our team and our clients’ media contentso we’re always bursting with enthusiasm for these projects.  As per our previous post on confidentiality, we can’t always talk about the various subjects we’re transcribing, so we’re super-excited for those times when we are permitted to sing a project’s praises from the second floor of our downtown Boston office. (This may also explain those times when the pigeons fly rapidly away form the director’s window — the bottom window on the right if you were wondering…)

But I digress…

Today we are thrilled to talk about Tamar Carroll of Rochester Institute of Technology and her forthcoming book,  We corresponded with Tamar via email, and she was kind enough to take some time to answer our questions and talk in detail about these interviews and what she hopes to learn and understand from them.

ATC: Tamar, tell us about these interviews you’re conducting in more detail.

CARROLL: The interviews I have done with more than 40 activists are research for my book, Mobilizing New York: Community Activism from the War on Poverty through the AIDS Epidemic, which is under contract for publication with the University of North Carolina Press in 2015. The book begins with Mobilization For Youth (MFY), a demonstration project for the War on Poverty located in the Lower East Side, and charts the transformation of this social welfare agency by the civil rights movement and the participation of African American and Puerto Rican mothers. I then follow a young social worker and Congress of Racial Equality (CORE) activist, Jan Peterson, from MFY to Williamsburg/Greenpoint, Brooklyn, where she founded in 1975 the National Congress of Neighborhood Women, a working-class feminist organization that established a college and jobs program as well as the first battered women’s shelter in New York City. Finally, I examine the collaboration between gay men and feminists in the AIDS Coalition to Unleash Power (ACT UP) and Women’s Health Action Mobilization (WHAM!) in the late 1980s and early 1990s,when their spectacular street theater and dramatic poster art reshaped the social geography of the city, leading to the creation of a supportive queer community as well as important changes in public policy on AIDS and medical research more broadly.

Mobilizing New York examines how residents have enacted participatory democracy, using self-education, consciousness-raising, public protest and civil disobedience to make American citizenship more inclusive. I also investigate the conditions that foster collaboration across lines of race, class, gender and sexuality, as well as the challenges posed by differences of identity.

ATC: What do you hope to learn from these interviews?

CARROLL: The interviews help me understand what motivates individuals to become activists and how they think about strategies, tactics, and movement goals. I also learn how they assess the triumphs and failures of the movements they have taken part in, and perhaps most significantly, how taking part in activism shaped their own lives.

ATC: Where and how can these interviews be accessed if made public?

CARROLL: I have donated my interviews with WHAM! and ACT UP members to the Tamiment Library at NYU, where the WHAM! papers are located, and my interviews with MFY and NCNW members to the Sophia Smith Collection at Smith College, where the papers of the NCNW and of Frances Fox Piven and Richard Cloward (Cloward founded MFY and they met there when she worked there) are. Both the audio files and transcripts are available for many of my interviews.

Stay tuned for the published book in 2015, and in the meanwhile ATC will continue to transcribe and blog about other fascinating projects each month (as we’re allowed by our clients).

Finally, you’re now able to ‘Like’ us on Facebook!

Keeping humans working since 1966

What comes to mind when you picture a transcription service? Since 1966, ATC has adjusted with the times by continuously learning from our experiences.  We always hire the best and most diverse team of transcription know-it-alls! 

No voice recognition software here, just awesome people!

 

Confidentiality IS a no-brainer!

 

Oy, the paperwork, the legalese, the “CYA” that’s now REQUIRED when running a transcription service…or any type of service, it seems.  It’s truly never-ending, and we spend hours upon hours reviewing agreements of all kinds with major institutions while they perform risk assessments of ATC’s downtown Boston office space.  Our founder, owner, and president Sandy’s favorite is showing off his circa 1940s Brownie box camera that sits perched on a high shelf in his office impersonating part of our state-of-the-art video security system.  He was thrilled the day one of the younger risk assessment people actually thought it WAS part of the security system.  What’s the reason for all of this, you may ask? It’s the “confidentiality conundrum” that truly isn’t a conundrum…a confidentiality agreement is a no-brainer.  So…does a confidentiality agreement automatically guarantee confidentiality?

 

Boston College Seal.svgAn oral history project at Boston College brought confidentiality agreements to the fore because of governmental treaty agreements between the U.K. and the U.S.  Boston College researchers conducted interviews with former IRA members as part of the Belfast Project, which was to be a future resource for academic researchers and journalists.  The recordings were desired for a U.K. investigation because they potentially had information on them that could be used against the interviewees in court.  The U.S. courts ruled for the release of recordings of the interviews, basically saying that the government investigations took precedence over the academic aspect of the interviews.  The Belfast Project organizers and the interviewees had agreed in advance on confidentiality and on the recordings remaining secret until after each of the interviewees’ deaths.  This was the critical criterion of the interviewees allowing the interviews to occur, because otherwise they felt they might be putting their own lives at risk.  This is a prime example of the “confidentiality conundrum.”
handshakeIt’s no wonder that interviewers and interviewees alike want guarantees that the content they’re discussing in their interview or focus group will remain CONFIDENTIAL.  We believe there should be guarantees, and we talk about them every day with clients.  So forms are sent and read and signed, and then we wait…and wait…for legal departments to approve paperwork.  Trust us, we do understand the importance of all of this, we truly do.  Maybe ATC learned this the hard way after 40+ years in business WITHOUT AN ISSUE.  Our integrity speaks for itself in the industry, because we wouldn’t have lasted for over 47 years if we hadn’t been doing something right.  Yes, there was a time when Sandy started this business (in 1966) that people understood verbal agreements, and a firm handshake.  Not so much anymore, it seems.
We always thought it was common sense to know what you transcribed at the office stayed at the office.  Clearly it was not as obvious as we thought, thanks to the onset of social media and what one individual called “an extension of my brain”—their “private” Twitter feed.
So here’s a quick story…  The director woke up one fine sunny day to find an employee had posted about something on their private Twitter feed and on their blog.  The Twitter post was “private” to the 100 people who were allowed to see those posts, including the director (their boss), while the blog was open for anyone to see. Now thankfully, the post was nothing about national security and didn’t contain any sensitive information.  In the blog post, the employee said, “Here’s an example of the types of things I work on at the office, and that I find interesting,” with a link to the client’s website.  The client called in before we could call them, asked why someone was writing about their business, and asked that we take it down.  We spoke with the employee immediately and had them remove the posts.  Then we had difficult decisions to make about the individual’s employment at ATC.  We ultimately decided that we had to terminate this person because they breached their confidentiality agreement and put the company’s integrity at risk.  It was a challenging decision, but it was the right decision for the company.
That was a number of years ago now.  What did we learn going forward?  Everyone who now works at ATC has to read, agree to, and sign a plethora of documents, including our confidentiality agreement, before they start working as a transcriptionist or on the production staff.  This agreement basically states what happens at the office stays at the office and CANNOT be shared anywhere.  Not verbally, not with Mom and Dad, a partner, a BFF; not on a blog, Facebook, Twitter, etc…  In this instance, someone crossed a line, and we resolved it in roughly 20 minutes.  We remind people in our interview process and then again in our training sessions once hired, about the critical importance of confidentiality for our clientele.  Every year, as part of our standard operating procedures, every member of our team must read, review, agree to, and sign the agreement again.  We call it the refresher course to remind everyone of the importance and seriousness of NOT TALKING outside of the ATC office.
Thankfully, being proactive, addressing the issue with the client, and continuously discussing the importance of understanding and following through on these agreements has helped us to continue our partnerships with existing clientele while allowing us to venture into new and exciting projects that have helped ATC continue its business growth.  
We think those of us that use the internet on a daily basis—minus maybe the former head of the CIA and possibly the director’s 7-, 10-, and 13-year-olds—know that anything put up online is no longer confidential, no matter what we may want to believe.  It always has the potential of biting us at some point if we’re not careful…or even if we’re very careful.

Rain, sleet, or "Snowpocalypse," ATC is here for all your transcription needs!

 Winter Storm Nemo, also known as “Snowpocalypse,” is arriving in New England, but team ATC is ready to make sure your audio and video content aren’t buried beneath the snowdrifts, or blown away in the blizzard-like winds.
(Blizzard of ’78 picture By David L. Ryan/Globe Staff/file 1978)

The Blizzard of 1978 caught many people by surprise, and Boston was shut down for days afterwards.

 Today, thanks to the latest advances in weather forecasting and the Internet, our team is able to “virtually” keep your projects moving (for those projects that allow such work).

**So please stay in touch with your orders and we’ll be sure to keep your transcription process moving to exceed your expectations.  ATC’s Boston office will close at 2 p.m. EST. Friday, February 8, 2013, but again we’ll be available virtually after that time until Monday at 8 a.m.  Call (617) 423 – 2151 with any needs prior to 2 p.m., or email us production@audiotranscriptioncenter.com.

Our virtual team will be able to keep your important projects moving, and they’ll be safe…wherever they are!

Of course, for those of you in the blizzard’s path, stay warm and stay safe!

 

Rain, sleet, or “Snowpocalypse,” ATC is here for all your transcription needs!

‘Twas the Night Before…

In honor of the holiday season we offer our fun transcription spin on
“’Twas the Night Before Christmas.”

 

 

 

 

 

 

 

 

 

 

 

Wishing everyone a very happy holiday season and new year!

Michael Sesling
Director
AUDIO TRANSCRIPTION CENTER

StoryCorps’s National Day of Listening

Thanksgiving is around the proverbial corner, and this holiday is typically a wonderful opportunity for friends and families to reconnect.  People being together offers a perfect time for stories to be passed around the holiday table along with helpings of stuffing and mashed potatoes. The potential for these stories to be handed and passed from generation to generation is at a peak while everyone is together.  What better way to collect, share, and save these stories from potentially being forgotten than by recording, archiving, and transcribing them for posterity?

We believe that StoryCorps’s The National Day of Listening is the perfect excuse to talk, listen, record, and transcribe.

We live in a special time when we’re not just able to orally pass stories down the line, but we’re also able ensure their archival longevity through the recording and transcribing of these personal and oral histories.

Take the time to find a quiet space, and set up your digital recorder.  Test the device to make sure you are recording properly.  Then, hit the record button and listen to and record the story.  It’s that simple, and it will be a gift  to read and listen to for generations.  This year, StoryCorps suggests honoring a veteran, and offers suggested conversation starters right on their website.

Don’t lose out on your family history and question yourself after it is too late.  We speak from our own missed opportunities.

Wishing you a peaceful Thanksgiving, and the opportunity to listen to, record and transcribe a new story never heard before.

In full disclosure, the Audio Transcription Center has partnered with StoryCorps on transcription of their audio recordings for their published books, Listening is an Act of Love, All There Is, and Mom , that we are humbled and proud to have participated in. 

Michael Sesling                                                           Sandy Poritzky
Director                                                                           Owner/President
michael@audiotranscriptioncenter.com                      sandy@audiotranscriptioncenter.com
(617) 423-2151                                                              (617) 423-2151