Reinforcement Learning for Hamiltonian Engineering of Dipolar Coupled Spin Systems*

In systems of electronic and nuclear spins, spin-spin interactions and onsite disorder can lead to a decay of the spin coherence. However, by applying a sequence of resonant pulses to the system, the effective Hamiltonian for the system can be engineered to suppress these effects and extend the coherence times of the spins. Low-order expansions of Average Hamiltonian Theory and Floquet theory have provided a framework to generate effective pulse sequences, both analytically and using numerical methods. The performance of these sequences varies depending on the relative strengths of local magnetic field variations (due chemical shift or disorder) and the strength of the dipolar coupling. We show that the reinforcement learning assisted sequence design can be tuned to the specific range of local field variations and interactions present in the experimental system of interest, while also allowing us to compensate for a broad range of experimental errors. We validate the performance of these sequences using numerical simulations and experimental tests of model systems.