Microsoft has made Project Malmo, a platform that uses the world of Minecraft as a testing ground for advanced artificial intelligence research, available for novice to experienced programmers on GitHub via an open-source license. The system, which had until now only been open to a small group of computer scientists in private preview, is primarily designed to help researchers develop more general artificial intelligence, or AI, that can do things like learn, hold conversations, make decisions and complete complex tasks.

That’s key to creating systems that can augment human intelligence — and eventually help us with everything from cooking and doing laundry to driving and performing lifesaving tasks in an operating room.

Katja Hofmann, a researcher in Microsoft’s Cambridge, UK, research lab, who leads the development of Project Malmo, said the system will help researchers develop new techniques and approaches to reinforcement learning. That’s an area of AI in which agents learn how to complete a task by being given a lot of room for trial and error and then being rewarded when they make the right decision.

"We’re trying to put out the tools that will allow people to make progress on those really, really hard research questions," Hofmann said.

For example, computer scientists have gotten exceptionally good at creating tools that can understand the words we say, whether we’re asking a gadget for directions or navigating an automated customer service line.

But when it comes to actually comprehending the meaning of those audio waves – well, in most cases a baby could do better.

"We’ve trained the artificial intelligence to identify patterns in the dictation, but the underlying technology doesn’t have any understanding of what those words mean," Hofmann said. "They’re just statistical patterns, and there’s no connection to any experience."

Teaching AI agents to comprehend humans in the same way we comprehend each other is one of the core goals of advanced artificial intelligence research. With Project Malmo’s public launch, the team has added functionality that will let computer scientists create bots that can learn to talk to each other, and to people.

Project Malmo also can be used to teach AI to do crafting – using tools and resources to build things like a table or a sword – and to learn how to get around on their own without falling down a hill or into a lava pit. They also can learn to build with blocks, navigate mazes and do any number of other tasks that mimic the types of things we might want AI to one day do in real life.

The researchers who have been part of Project Malmo’s private preview say Minecraft, with its immersive world and endless possibilities for collaboration and exploration, is ideally suited for general AI research.

"Minecraft is very close to the real world in many ways," said Jose Hernandez-Orallo, a professor at the Technical University of Valencia, Spain, who has been part of the private preview. "There are so many possibilities."

Doing this kind of research requires a lot of trial and error, with small and incremental victories along the way. That’s why, when Project Malmo launches publicly, it also will have another new feature: Overclocking, or the ability to run experiments faster than the usual pace of Minecraft’s world.

Evelyne Viegas, director of AI outreach at Microsoft Research, said that will allow researchers to get results, and make adjustments, more quickly.

The AI researchers who have gotten a sneak peek at Project Malmo say another key advantage to the system is that it will let researchers compare their progress against the work of others, by seeing how well their theories perform in the same environment.

Hernandez-Orallo said AI researchers are often developing their own systems for testing their theories and algorithms. That allows them to solve isolated problems, but it can be tough to know how those results compare to, or would complement, the work of others.

With a system like Project Malmo, he said researchers can test their systems in the same Minecraft setting.

The open-source environment also allows researchers to much more easily collaborate, sharing research insights and bringing their findings together.

The Project Malmo platform consists of a mod for the Java version and code that helps AI agents sense and act within the Minecraft environment. The two components can run on Windows, Linux or Mac OS, and programmers can use any programming language they are comfortable with.