Learning to unknot. Issue 2 (21st April 2021)

• Record Type: Journal Article
• Authors: Gukov, Sergei; Halverson, James; Ruehle, Fabian; Sułkowski, Piotr
• Is Part Of: Machine learning: science and technology. Volume 2:Issue 2(2021)
• Publication Date: 2021-04-21
• Subjects: knot theory -- string theory -- machine learning -- reinforcement learning; 006.31
• DOI: 10.1088/2632-2153/abe91f
• Languages: English
• ISSNs: 2632-2153

Abstract

Abstract: We introduce natural language processing into the study of knot theory, as made natural by the braid word representation of knots. We study the UNKNOT problem of determining whether or not a given knot is the unknot. After describing an algorithm to randomly generate N -crossing braids and their knot closures and discussing the induced prior on the distribution of knots, we apply binary classification to the UNKNOT decision problem. We find that the Reformer and shared-QK Transformer network architectures outperform fully-connected networks, though all perform at ≳ 95% accuracy. Perhaps surprisingly, we find that accuracy increases with the length of the braid word, and that the networks learn a direct correlation between the confidence of their predictions and the degree of the Jones polynomial. Finally, we utilize reinforcement learning (RL) to find sequences of Markov moves and braid relations that simplify knots and can identify unknots by explicitly giving the sequence of unknotting actions. Trust region policy optimization (TRPO) performs consistently well, reducing ≳ 80% of the unknots with up to 96 crossings we tested to the empty braid word, and thoroughly outperformed other RL algorithms and random walkers. Studying these actions, we find that braid relations are more useful in simplifying to the unknot than one of the Markov moves.