viralamo

Menu
  • Technology
  • Science
  • Money
  • Culturs
  • Trending
  • Video

Subscribe To Our Website To Receive The Last Stories

Join Us Now For Free
Home
Technology
OpenAI’s Procgen Benchmark prevents AI model overfitting
Technology

OpenAI’s Procgen Benchmark prevents AI model overfitting

03/12/2019

Where the training of machine learning models is concerned, there’s always a risk of overfitting — or corresponding to closely — to a particular set of data. In point of fact, it’s not infeasible that popular machine learning benchmarks like the Arcade Learning Environment encourage overfitting, in that they have a low emphasis on generalization.

That’s why OpenAI — the San Francisco-based research firm cofounded by CTO Greg Brockman, chief scientist Ilya Sutskever, and others — today released the Procgen Benchmark, a set of 16 procedurally-generated environments (CoinRun, StarPilot, CaveFlyer, Dodgeball, FruitBot, Chaser, Miner, Jumper, Leaper, Maze, BigFish, Heist, Climber, Plunder, Ninja, and BossFight) that measure how quickly a model learns generalizable skills. It builds atop the startup’s CoinRun toolset, which used procedural generation to construct sets of training and test levels.

“We want the best of both worlds: a benchmark comprised of many diverse environments, each of which fundamentally requires generalization,” wrote OpenAI in a blog post. “To fulfill this need, we have created Procgen Benchmark … [which strives] for all of the following: experimental convenience, high diversity within environments, and high diversity across environments … CoinRun now serves as the inaugural environment in Procgen Benchmark, contributing its diversity to a greater whole.”

OpenAI Procgen Benchmark Dodgeball

Above: The Dodgeball environment in OpenAI’s Procgen Benchmark.

Image Credit: OpenAI

According to OpenAI, Procgen environments were designed with a large amount of freedom (subject to basic design constraints) so as to present AI-driven agents with “meaningful” generalization challenges. They were also calibrated to ensure baseline agents make significant progress after training for 200 million time steps, and to perform thousands of steps per second on as little as a single processor core.

Additionally, Procgen environments support two “well-calibrated” difficulty settings: Easy and hard. (The former targets users with limited access to compute power, as it requires roughly an eighth of the resources to train.) And they mimic the style of a number of Atari and Gym Retro games, in keeping with precedent.

OpenAI Procgen Benchmark Spaceship

Above: The StarPilot environment.

Image Credit: OpenAI

According to OpenAI, AI model performance generally improves as the training set grows. “We believe this increase in training performance comes from an implicit curriculum provided by a diverse set of levels,” the blog authors explain. “A larger training set can improve training performance if the agent learns to generalize even across levels in the training set.”

OpenAI leaves to future work more complex settings, which it believes will inform more capable and efficient AI models. “[The] vast gap between training and test performance is worth highlighting. It reveals a crucial hidden flaw in training on environments that follow a fixed sequence of levels,” wrote OpenAI.

OpenAI Procgen Benchmark Chaser

Above: The Chaser environment.

Image Credit: OpenAI

OpenAI previously released Neural MMO, a “massively multiagent” virtual training ground that plops agents in the middle of an RPG-like world, and Gym, a proving ground for algorithms for reinforcement learning (which involves training machines to do things based on trial and error). More recently, it made available SafetyGym, a suite of tools for developing AI that respects safety constraints while training, and for comparing the “safety” of algorithms and the extent to which those algorithms avoid mistakes while learning.

Source link

Share
Tweet
Pinterest
Linkedin
Stumble
Google+
Email
Prev Article
Next Article

Related Articles

The DeanBeat: Gamers count down the days to The Last of Us Part II
The countdown to the launch of Sony’s The Last of …

The DeanBeat: Gamers count down the days to The Last of Us Part II

PlayStation sales drop 20%, but PS Plus is smoothing the next-gen jump
The PlayStation 5 is coming. Sony Interactive Entertainment is launching …

PlayStation sales drop 20%, but PS Plus is smoothing the next-gen jump

Leave a Reply Cancel reply

Find us on Facebook

Related Posts

  • 5G in 2020: How devices and networks will evolve over the next year
    Updated international wireless emission guidelines address 5G …
    11/03/2020
  • The newest members of the $100M ARR club – TechCrunch
    The newest members of the $100M ARR …
    13/12/2019
  • AT&T promises fiber-to-the-home expansion in 90 metro areas this year
    AT&T promises fiber-to-the-home expansion in 90 metro …
    12/03/2021
  • AMD Radeon RX 5600 XT review — More than enough 1080p power
    AMD Radeon RX 5600 XT review — …
    21/01/2020
  • Ubisoft releases its own list of PS4 games that won’t work on PlayStation 5
    Ubisoft releases its own list of PS4 …
    30/10/2020

Popular Posts

  • 10 Real Historical Events That Inspired ‘Game …
    22/05/2022 0
  • Top 10 Most Singular Encounters with Unidentified …
    24/04/2022 0
  • 10 Creepy Apocalyptical Predictions – Listverse
    25/04/2022 0
  • 10 Meetings That Shaped History – Listverse
    25/04/2022 0
  • The first “Meta Store” is opening in California in May
    The first “Meta Store” is opening in …
    25/04/2022 0

viralamo

Pages

  • Contact Us
  • Privacy Policy
Copyright © 2022 viralamo
Theme by MyThemeShop.com

Ad Blocker Detected

Our website is made possible by displaying online advertisements to our visitors. Please consider supporting us by disabling your ad blocker.

Refresh