LONDON – DeepMind, the London-based artificial intelligence company owned by Alphabet Inc., is planning to let its software learn how to fold proteins, an important problem for drug discovery.
The company is best known for AlphaGo, software that beat the world’s top human players at the ancient strategy game go. But now it has created software based on a different design, called AlphaGo Zero, which can beat all previous versions of AlphaGo. Unlike earlier versions, AlphaGo Zero learned completely from scratch, with no knowledge of how humans play the game, DeepMind chief executive Demis Hassabis said at a news conference held ahead of the publication of the new research in the scientific journal Nature on Wednesday.
DeepMind’s latest project shows how its studies could be of increasing practical importance to its parent company. Last year Alphabet put a DeepMind AI system in control of parts of its data centers to reduce power consumption by manipulating computer servers and related equipment like cooling systems.
What is more, AlphaGo Zero used one-twelfth of the computing power of the version that beat 18-time world champion go player Lee Sedol in 2016. It ran on just four Tensor Processing Units (TPUs), chipsets optimized for machine learning that Google has created for its data centers, compared with 48 on the previous version of AlphaGo.
Hassabis said the company is now planning to apply an algorithm based on AlphaGo Zero to other domains with real-world applications, starting with protein folding. To build drugs against various viruses, researchers need to know how proteins fold.
Alphabet has become increasingly interested in the health care sector. In July Verily, the life-sciences arm of Alphabet, and Swiss pharmaceuticals giant Novartis AG invested in a $300 million fund started by European venture capital firm Medicxi to hunt for promising opportunities in the drugs industry. Verily also unveiled a venture last year with French drugmaker Sanofi to tackle diabetes by combining devices and medicine, and it has also formed a venture with the U.K.’s GlaxoSmithKline PLC to explore the use of electrical signals to treat diseases.
It has also run into regulatory issues. A product test at a British hospital involving DeepMind violated British data protection laws, the U.K.’s top privacy watchdog ruled in July.
While supercomputers have been previously applied to protein folding, the results have not been spectacular.
David Silver, the principal researcher on DeepMind’s go project, said AlphaGo Zero belied conventional wisdom that leaps forward in artificial intelligence have mostly come from bigger and better data sets and more powerful computers. “It is the novel algorithms that really matter,” he said. “It is actually the algorithmic advances that lead to more progress than either compute power or data.”
AlphaGo Zero, starting from no knowledge except the rules of go and no input other than the black and white colored stones on the go board, begins with random moves. After 36 hours it outperformed the version of AlphaGo that defeated 18-time world champion Lee Sedol in 2016. After 72 hours, it could beat that system 100 games to zero. After 40 days and 29 million games, the system was capable of beating DeepMind’s AlphaGo Master, which had defeated the world’s top-ranked player Ke Jie, by 89 games to 11.
DeepMind’s latest project shows that reinforcement learning — in which software learns to maximize a reward entirely from experience, in the way a laboratory rat learns to navigate a maze — may be more powerful than other learning approaches that rely on encoding human expertise or finding patterns in large sets of either labeled or unlabeled data. Most AI software that is being deployed commercially at the moment — for tasks as diverse as facial recognition, parsing legal documents and self-driving cars — is based on these data-intensive approaches.
Hassabis said that using real world data, particularly human-generated or labeled data, is problematic because it can be expensive, publicly-unavailable or biased.
In a time of both misinformation and too much information, quality journalism is more crucial than ever.
By subscribing, you can help us get the story right.