viralamo

Menu
  • Technology
  • Science
  • Money
  • Culturs
  • Trending
  • Video

Subscribe To Our Website To Receive The Last Stories

Join Us Now For Free
Home
Technology
Uber creates AI to generate data for training other AI models
Technology

Uber creates AI to generate data for training other AI models

19/12/2019

Generative adversarial networks (GANs) — two-part AI systems consisting of generators that create samples and discriminators that attempt to distinguish between the generated samples and real-world samples — have countless uses, and one of them is producing synthetic data. Researchers at Uber recently leveraged this in a paper titled “Accelerating Neural Architecture Search by Learning,” which proposes a tailored GAN — dubbed Generative Teaching Network (GTN) — that generates data or training environments from which a model learns before it gets tested on a target task. The paper states that GTNs helped speed up searches by up to nine times compared with approaches that use real data alone, and that GTNs are competitive with state-of-the-art architectures that achieve top performance while using “orders of magnitude” less computation.

As the contributing authors explain in a blog post, most model searches require “substantial” resources because they evaluate models by training them on a data set until their performance no longer improves. This process might be repeated for thousands or more model architectures in a single cycle, which is both expensive in terms of computation and incredibly time-consuming. Some algorithms avoid the cost by only training for a small amount of time and taking the resulting performance as an estimate of true performance, but this training can be further sped up by tapping machine learning — i.e., GTNs — to create training data.

GTNs achieve success by creating unrealistic data that’s helpful in the course of learning. They’re able to combine information about many different types of an object together, or focus training mostly on the hardest examples, and to evaluate the model-in-training on real-world data. Furthermore, they use a learning curriculum — a set of training examples in a specific order — to improve performance over generators that produce unordered random distributions of examples.

In experiments, the team says that models trained by GTNs achieved 98.9% accuracy on the popular open source MNIST data set in 32 steps (about 0.5 seconds) of training, over which they ingested 4,096 synthetic images once (less than 10% of the images in the MNIST training data set). Evaluated on another data set — CIFAR-10, which is designed to measure model search performance — the models learned up to four times faster than on real data for the same performance level, even when compared with an optimized real-data learning algorithm. Moreover, performance on GTN data turned out to be generally predictive of true performance — that is, achieving the same predictive power as achieved with only 128 steps on GTN-generated data would have required 1,200 steps on real data.

“Because GTNs evaluate each architecture faster, they are able to evaluate more total architectures within a fixed compute budget. In every case we tried, using GTN-generated data proved to be faster and led to higher performance than using real data. That result held even when we gave the real-data control ten days of compute compared to two-thirds of a day for GTN,” wrote the coauthors. “Through our research, we showed that GTN-generated training data creates a fast … method that is competitive with state-of-the-art … algorithms, but via an entirely different approach. Having this extra tool of GTNs in our … toolbox can help Uber, all companies, and all scientists around the world improve the performance of deep learning in every domain in which it is being applied.”

Source link

Share
Tweet
Pinterest
Linkedin
Stumble
Google+
Email
Prev Article
Next Article

Related Articles

PlayStation 5 gets Godfall looter-slasher from Gearbox Publishing
TechCrunch ist Teil von Verizon Media. Klicken Sie auf ‘Ich …

Join our conference call with immigration attorney Sophie Alcorn Tuesday at 1pm PDT

Border Patrol flies anti-terrorism drone over Minneapolis protestors
Customs and Border Patrol Thousands of people took to the …

Border Patrol flies anti-terrorism drone over Minneapolis protestors

Leave a Reply Cancel reply

Find us on Facebook

Related Posts

  • Crisis VRigade: From Facebook reject to SideQuest success
    Crisis VRigade: From Facebook reject to SideQuest …
    18/01/2020
  • CEO Frank Gibeau: Why Zynga bought Peak Games for $1.8 billion
    CEO Frank Gibeau: Why Zynga bought Peak …
    05/06/2020
  • Fast & Furious: Crossroads lives video games a quarter-mile at a time
    Save over $200 with discounted student tickets …
    16/01/2020
  • iDevices finally get key-based protection against account takeovers
    iPhones and iPads finally get key-based protection …
    17/12/2019
  • PlayStation 5 gets Godfall looter-slasher from Gearbox Publishing
    County deems Tesla a ‘non-essential’ business during …
    18/03/2020

Popular Posts

  • Microsoft fends off record-breaking 3.47 Tbps DDoS attack
    Pro-Russia threat group Killnet is pummeling Lithuania …
    27/06/2022 0
  • 10 Huge Problems Animals Should Have But …
    30/05/2022 0
  • 10 U.S. Towns with Terrifying Local Legends …
    30/05/2022 0
  • 10 Inventions Meant for the Military They …
    31/05/2022 0
  • 10 Darkest Rock Albums Ever Made – …
    31/05/2022 0

viralamo

Pages

  • Contact Us
  • Privacy Policy
Copyright © 2022 viralamo
Theme by MyThemeShop.com

Ad Blocker Detected

Our website is made possible by displaying online advertisements to our visitors. Please consider supporting us by disabling your ad blocker.

Refresh