viralamo

Menu
  • Technology
  • Science
  • Money
  • Culturs
  • Trending
  • Video

Subscribe To Our Website To Receive The Last Stories

Join Us Now For Free
Home
Technology
LinkedIn open-sources toolkit to measure AI model fairness
Technology

LinkedIn open-sources toolkit to measure AI model fairness

26/08/2020

LinkedIn today released the LinkedIn Fairness Toolkit (LiFT), an open source software library designed to enable the measurement of fairness in AI and machine learning workflows. The company says LiFT can be deployed during training and scoring to measure biases in training data sets, and to evaluate notions of fairness for models while detecting differences in their performance across subgroups.

There are countless definitions of fairness in AI, each capturing different aspects of fairness to users. Monitoring models along these definitions is a step toward ensuring fair experiences, but although several toolkits tackle fairness-related challenges, most don’t address large-scale problems and are tied to specific cloud environments.

By contrast, LiFT can be leveraged for ad hoc fairness analysis or as a part of any large-scale A/B testing system. It’s usable for exploratory analysis and in production, with bias measurement components that can be integrated into stages of a machine learning training and serving system. Moreover, it introduces a novel metric-agnostic testing framework that can detect statistically significant differences in performance as measured across different subgroups.

LinkedIn LiFT

LiFT is reusable, LinkedIn says, with wrappers and a configuration language intended for deployment. At the highest level, the library provides a basic driver program powered by a simple configuration, enabling fairness measurement for data sets and models without the need to write code and related unit tests. But LiFT also provides access to higher-level and lower-level APIs that can be used to compute fairness metrics at all levels of granularity, with the ability to extend key classes to enable custom computation.

To achieve scalability, LiFT taps Apache Spark, loading data sets into an organized database with only the primary key, labels, predictions, and protected attributes. Data distributions are computed and stored on a single system in-memory to speed up the computation of subsequent fairness metric computations; users can operate on these distributions or deal with cached data sets for more involved metrics.

To date, LinkedIn says it has applied LiFT internally to measure the fairness metrics of training data sets for models prior to their training. In the future, the company plans to increase the number of pipelines where it’s measuring and mitigating bias on an ongoing basis through deeper integration of LiFT.

“News headlines and academic research have emphasized that widespread societal injustice based on human biases can be reflected both in the data that is used to train AI models and the models themselves. Research has also shown that models affected by these societal biases can ultimately serve to reinforce those biases and perpetuate discrimination against certain groups,” LinkedIn senior software engineer Sriram Vasudevan, machine learning engineer Cyrus DiCiccio, and staff applied researcher Kinjal Basu wrote in a blog post. “We are working toward creating a more equitable platform by avoiding harmful biases in our models and ensuring that people with equal talent have equal access to job opportunities.”

Source link

Share
Tweet
Pinterest
Linkedin
Stumble
Google+
Email
Prev Article
Next Article

Related Articles

VentureBeat’s flagship AI event, Transform, goes fully digital and extends to 3 days
VentureBeat is excited to announce Tame as the technology platform …

VB Transform 2020, the event for AI decision-makers, to be hosted online with Tame

Nvidia develops lightweight VR gaze tracking system using LED sensors
All of the world’s top virtual reality headset makers agree …

Nvidia develops lightweight VR gaze tracking system using LED sensors

Leave a Reply Cancel reply

Find us on Facebook

Related Posts

  • Fast & Furious: Crossroads lives video games a quarter-mile at a time
    Cookie consent tools are being used to …
    12/01/2020
  • LucidSound’s LS1 and LS10 headsets are solid and affordable
    LucidSound’s LS1 and LS10 headsets are solid …
    24/01/2020
  • Startup Genome: 80 regions have produced unicorns as tech democratizes
    Startup Genome: 80 regions have produced unicorns …
    25/06/2020
  • Fast & Furious: Crossroads lives video games a quarter-mile at a time
    Google Search will make mobile-first indexing the …
    05/03/2020
  • Beat Saber is now an Oculus studio after Facebook acquisition
    Founders Fund confirms $3 billion in new …
    19/02/2020

Popular Posts

  • 100 million more IoT devices are exposed—and they won’t be the last
    100 million more IoT devices are exposed—and …
    14/04/2021 0
  • Mimecast says SolarWinds hackers breached its network and spied on customers
    Mimecast says SolarWinds hackers breached its network …
    16/03/2021 0
  • Touch of gray: The Air Force can’t retire the Boeing 707
    Touch of gray: The Air Force can’t …
    17/03/2021 0
  • Top 10 Places Creepier Than Stephen King’s …
    17/03/2021 0
  • Top 10 Things You Should Know About …
    17/03/2021 0

viralamo

Pages

  • Contact Us
  • Privacy Policy
Copyright © 2021 viralamo
Theme by MyThemeShop.com

Ad Blocker Detected

Our website is made possible by displaying online advertisements to our visitors. Please consider supporting us by disabling your ad blocker.

Refresh