viralamo

Menu
  • Technology
  • Science
  • Money
  • Culturs
  • Trending
  • Video

Subscribe To Our Website To Receive The Last Stories

Join Us Now For Free
Home
Technology
Researchers find face masks have no ‘significant’ effect on speech recognition accuracy
Technology

Researchers find face masks have no ‘significant’ effect on speech recognition accuracy

21/08/2020

Can face masks affect the accuracy of automatic speech recognition systems? That’s the question researchers at the Educational Testing Service (ETS), the nonprofit assessment organization headquartered in Princeton, New Jersey, sought to answer in a study published this week. Drawing on recordings from ETS’ English language proficiency test, for which exam-takers were required to wear face masks, they found that while differences between the recordings and no-mask baselines existed, they didn’t lead to “significant” variations in scores.

The pandemic has led to a dramatic increase in the use of face masks worldwide, with 65% of U.S. adults saying they wore a mask in stores during the month of May, according to the Pew Research Center. This has potential implications for the speech algorithms underpinning smart speakers, smart displays, mobile apps, and indeed automated language proficiency tests. Face coverings come in all sizes and thicknesses and can impact a wearer’s speech patterns, for example by distorting the sound of a person’s speech or by greatly attenuating it.

The researchers set out to determine whether masks might introduce bias in automated language proficiency exams — a salient question considering regulations in some regions of the world make mask-wearing compulsory for test-takers. They collated a corpus of 1,188 responses from 597 people collected in a language test in Hong Kong between February and March, during which exam-takers were tasked with answering questions for between 45 seconds and 1 minute each.

For the purposes of comparison, the researchers created a baseline with 1,200 spoken responses from 300 people who took the test in fall 2019, before mask-wearing rules were implemented.

To suss out the differences between the two data sets, the researchers extracted and compared 88 acoustic features including measurements related to frequency, amplitude, and spectral characteristics. They also considered whether face masks had any effect on test-taker speech patterns, using speech recognition hypotheses and timestamps to compute features designed to capture whether those wearing masks made more pauses, spoke more slowly, or showed different patterns of disfluencies.

The coauthors report that four features they considered — average duration of silences and number of silences per word as well as the duration of chunks between pauses — showed differences. Speakers wearing masks spoke with about the same articulation rate as those not wearing masks, but paused slightly more often, and wearing masks reduced the duration of chunks between two pauses by 0.6 words (or 0.2 seconds).

These differences, however, didn’t appear to manifest in speech recognition performance metrics. After comparing a sample of 55 transcribed responses — 28 from the mask-wearing group and 27 from the baseline group — the researchers found the word error rate was lower for mask wearers compared with those not donning masks (27.6% versus 20.7%). They also report that the mean test scores across both groups were virtually the same: 2.79 for the baseline and 2.80 for the mask-wearers.

The researchers might have a conflict of interest given the test they evaluated is ETS’ own and that their sample size is on the small side. But in support of their findings, they cite previous, smaller studies showing masks have “no significant effect” on language proficiency scores assigned by raters or on the accuracy of “closed-set” speaker identification systems.

“Our classifier experiments showed that it is possible to predict with almost 80% accuracy whether a test-taker is wearing a mask or not … However, these differences in acoustics and speech patterns did not have a further effect on the performance of automated speech recognition or the automated scoring engine,” the researchers wrote. “The differences we observed for low-level acoustic features suggest that some types of technologies and applications may be more affected than others.”

The work follows a study from Duke Kunshan University, Wuhan University, Lenovo, and Sun Yat-sen University in Guangzhou describing a system that can detect with 78.8% accuracy whether a person is wearing a mask from the sound of their speech. Masked speech detection is a sub-challenge at the 11th annual Computational Paralinguistics Challenge (ComParE), which is scheduled to take place during the upcoming Interspeech 2020 conference in October.

Source link

Share
Tweet
Pinterest
Linkedin
Stumble
Google+
Email
Prev Article
Next Article

Related Articles

Nvidia develops lightweight VR gaze tracking system using LED sensors
All of the world’s top virtual reality headset makers agree …

Nvidia develops lightweight VR gaze tracking system using LED sensors

AI experts urge machine learning researchers to tackle climate change
At the Tackling Climate Change workshop at this year’s NeurIPS …

AI experts urge machine learning researchers to tackle climate change

Leave a Reply Cancel reply

Find us on Facebook

Related Posts

  • Amazon’s third-party merchants are now barred from using FedEx Ground for Prime shipments – TechCrunch
    Amazon’s third-party merchants are now barred from …
    17/12/2019
  • Biden’s top tech adviser makes regulation more likely
    Biden’s top tech adviser makes regulation more …
    23/11/2020
  • Fast & Furious: Crossroads lives video games a quarter-mile at a time
    Startups Weekly: Tech layoffs spread (a bit)
    25/01/2020
  • COVID-19 tracing apps now live in Germany, France, and Italy; U.K. rethinks its plans
    COVID-19 tracing apps now live in Germany, …
    20/06/2020
  • TechCrunch’s Favorite Things of 2019
    How Huawei is dividing Western nations
    28/03/2020

Popular Posts

  • Home alarm tech backdoored security cameras to spy on customers having sex
    Home alarm tech backdoored security cameras to …
    22/01/2021 0
  • Nuro acquires self-driving truck startup Ike
    Nuro acquires self-driving truck startup Ike
    24/12/2020 0
  • U.S. Justice Department going ‘full tilt’ on tech antitrust probe
    Google told its AI research scientists to …
    24/12/2020 0
  • Moon Active acquires Family Island mobile game maker Melsoft
    Moon Active acquires Family Island mobile game …
    24/12/2020 0
  • Top 10 Crazy Christmas Hazards – Listverse
    24/12/2020 0

viralamo

Pages

  • Contact Us
  • Privacy Policy
Copyright © 2021 viralamo
Theme by MyThemeShop.com

Ad Blocker Detected

Our website is made possible by displaying online advertisements to our visitors. Please consider supporting us by disabling your ad blocker.

Refresh
We use cookies to ensure that we give you the best experience on our website. If you continue to use this site we will assume that you are happy with it.I AgreePrivacy policy