4.8 Article

Realizing a deep reinforcement learning agent for real-time quantum feedback

Related references

Note: Only part of the references are listed.
Article Multidisciplinary Sciences

Real-time quantum error correction beyond break-even

V. V. Sivak et al.

Summary: Quantum error correction (QEC) aims to counteract decoherence in quantum systems. Previous attempts faced excessive errors that overwhelmed the error-correcting capability. This study demonstrates a fully stabilized and error-corrected qubit with substantially longer coherence than imperfect quantum components, achieved through innovations in quantum circuits and reinforcement learning.

NATURE (2023)

Proceedings Paper Computer Science, Hardware & Architecture

Scalable Quantum Error Correction for Surface Codes using FPGA

Namitha Liyanage et al.

Summary: A fault-tolerant quantum computer requires decoding and correcting errors faster than they occur. The Union-Find (UF) decoder has a promising average time complexity slightly higher than O(d(3)). A distributed version of the UF decoder using parallel computing resources has been developed, showing sublinear average time complexity with respect to d. The implementation utilizes a scalable architecture called Helios and achieved a decoding time of 120 ns per measurement round for d up to 7.

2023 IEEE 31ST ANNUAL INTERNATIONAL SYMPOSIUM ON FIELD-PROGRAMMABLE CUSTOM COMPUTING MACHINES, FCCM (2023)

Article Optics

Artificial intelligence and machine learning for quantum technologies

Mario Krenn et al.

Summary: In recent years, the rapid development in machine learning has had a significant impact on various fields of science and technology. This perspective article explores how quantum technologies are benefiting from this revolution. It showcases how scientists have utilized machine learning and artificial intelligence to analyze quantum measurements, estimate parameters of quantum devices, discover new quantum experimental setups and protocols, and improve aspects of quantum computing, communication, and simulation. The article also highlights the challenges and future possibilities in the field and provides speculative visions for the next decade.

PHYSICAL REVIEW A (2023)

Article Multidisciplinary Sciences

Magnetic control of tokamak plasmas through deep reinforcement learning

Jonas Degrave et al.

Summary: Nuclear fusion using magnetic confinement, specifically in the tokamak configuration, is a promising method for sustainable energy. In this study, researchers introduce a previously undescribed architecture for the design of tokamak magnetic controllers, which autonomously learns to command the full set of control coils. This approach demonstrates unprecedented flexibility and generality in problem specification, leading to a notable reduction in design effort and the ability to produce new plasma configurations.

NATURE (2022)

Article Physics, Applied

Deep-Neural-Network Discrimination of Multiplexed Superconducting-Qubit States

Benjamin Lienhard et al.

Summary: This research presents a method of using neural networks for multiqubit readout. The experimental results demonstrate that this approach can effectively reduce the assignment error rate when dealing with system-dependent nonidealities.

PHYSICAL REVIEW APPLIED (2022)

Article Physics, Multidisciplinary

Experimentally realizing efficient quantum control with reinforcement learning

Ming-Zhong Ai et al.

Summary: In this experimental study, deep reinforcement learning (DRL) is investigated as an artificial intelligence approach for controlling quantum systems. The results show that DRL can explore fast and robust digital quantum controls with operation time analytically hinted by shortcuts to adiabaticity. The experiment demonstrates that DRL outperforms analytical methods in terms of gate operation time, energy cost, and fidelity under time-varying stochastic errors, presenting a computer-inspired framework for quantum control.

SCIENCE CHINA-PHYSICS MECHANICS & ASTRONOMY (2022)

Article Multidisciplinary Sciences

Deep reinforcement learning for self-tuning laser source of dissipative solitons

Evgeny Kuprikov et al.

Summary: The increasing complexity of modern laser systems, mainly due to nonlinear dynamics of radiation, presents challenges in control and calls for new approaches in laser engineering. Machine learning methods have been applied to mode-locked fiber lasers in areas of self-starting, system optimization, and characterization. Deep reinforcement learning has shown success in controlling the generation of dissipative solitons in mode-locked fiber laser systems and demonstrating the potential to generalize knowledge about the laser system for stable pulse generation.

SCIENTIFIC REPORTS (2022)

Article Optics

Deep reinforcement with spectrum series learning control for a mode-locked fiber laser

Zhan Li et al.

Summary: A spectrum series learning-based model is proposed for mode-locked fiber laser state searching and switching. The model combines deep reinforcement learning and long short-term memory networks to obtain the mode-locked operation search policy. The switch of the mode-locked state is realized by a predictive neural network that controls the pump power. Experimental results show that this new method achieves high efficiency and accuracy in searching and switching mode-locked states.

PHOTONICS RESEARCH (2022)

Article Physics, Applied

Deep Reinforcement Learning for Quantum Hamiltonian Engineering

Pai Peng et al.

Summary: This paper uses deep reinforcement learning techniques to search for Hamiltonian engineering sequences in quantum many-body systems and experimentally demonstrates their superiority. By training DRL agents and considering experimental imperfections, robust output sequences are obtained. In addition, the paper also discovers a common pattern with a meaningful analytical description that was previously unknown, and restricts the search space based on this control pattern to obtain long sequences that are robust against experimental imperfections.

PHYSICAL REVIEW APPLIED (2022)

Article Physics, Multidisciplinary

Deep Reinforcement Learning for Quantum State Preparation with Weak Nonlinear Measurements

Riccardo Porotti et al.

Quantum (2022)

Article Physics, Multidisciplinary

Measurement-Based Feedback Quantum Control with Deep Reinforcement Learning for a Double-Well Nonlinear Potential

Sangkha Borah et al.

Summary: Closed loop quantum control uses measurement to control quantum system dynamics towards desired target states or dynamics. Deep reinforcement learning can effectively learn to control highly nonlinear quantum systems towards the ground state.

PHYSICAL REVIEW LETTERS (2021)

Article Physics, Multidisciplinary

Faster State Preparation across Quantum Phase Transition Assisted by Reinforcement Learning

Shuai-Feng Guo et al.

Summary: A faster sweeping policy based on excited level dynamics is reported for the transformation of a three-mode balanced Dicke state, using deep reinforcement learning (DRL). The experiment shows that DRL can achieve the target state in a shorter time, highlighting the potential for quantum dynamics control and quantum state preparation in interacting many-body systems.

PHYSICAL REVIEW LETTERS (2021)

Review Physics, Multidisciplinary

Circuit quantum electrodynamics

Alexandre Blais et al.

Summary: Circuit quantum electrodynamics (QED) is an independent and thriving field of research that allows unprecedented detailed study and control of light-matter interaction at the quantum level. It has become essential in current approaches to gate-based digital quantum information processing with superconducting circuits, and also provides a framework for the study of hybrid quantum systems. The coherent coupling of superconducting qubits to microwave photons, dispersive qubit readout, and different regimes of light-matter interaction are key aspects of circuit QED.

REVIEWS OF MODERN PHYSICS (2021)

Article Robotics

Reinforcement learning with artificial microswimmers

S. Muinos-Landin et al.

Summary: Artificial microswimmers, combined with machine learning algorithms, are studied for their adaptive behavior in noisy environments. The study shows that collective learning is possible with external control, and noise affects learning speed and decision-making strength. Time delays in feedback loops can lead to optimal behaviors, similar to bacteria's run-and-tumble times, in systems responding to noise.

SCIENCE ROBOTICS (2021)

Article Optics

Low-latency deep-reinforcement learning algorithm for ultrafast fiber lasers

Qiuquan Yan et al.

Summary: Machine learning is increasingly applied in the field of ultrafast photonics. This paper presents a deep-reinforcement learning algorithm for automatic mode-locked operation in a saturable absorber-based ultrafast fiber laser (UFL). Two experiments were conducted to verify the effectiveness and robustness of the algorithm, which lays the foundation for remote maintenance and centralized control of UFLs.

PHOTONICS RESEARCH (2021)

Article Quantum Science & Technology

Deep reinforcement learning for efficient measurement of quantum devices

V. Nguyen et al.

Summary: This paper introduces an efficient measurement approach for quantum devices based on deep reinforcement learning, focusing on automatic identification of specific transport features in double quantum dot devices. The algorithm can identify bias triangles in a mean time of <30min, showcasing the utility of deep reinforcement learning in decision making for quantum device measurement and operation.

NPJ QUANTUM INFORMATION (2021)

Article Quantum Science & Technology

Experimental Deep Reinforcement Learning for Error-Robust Gate-Set Design on a Superconducting Quantum Computer

Yuval Baum et al.

Summary: The use of deep reinforcement learning to design error-robust quantum logic gates has shown improved efficiency and stability in quantum computing, with experimental results demonstrating good performance. When compared to other black-box optimization techniques, gates derived through deep reinforcement learning can achieve comparable or marginally superior performance levels.

PRX QUANTUM (2021)

Article Computer Science, Artificial Intelligence

Reinforcement learning decoders for fault-tolerant quantum computation

Ryan Sweke et al.

Summary: Topological error correcting codes, particularly the surface code, are currently the most feasible roadmap for large-scale fault-tolerant quantum computation. This research shows that decoding such codes can be reformulated as interactions between a decoding agent and a code environment, using reinforcement learning to obtain decoding agents. By using deep Q learning, decoding agents for various simplified phenomenological noise models were obtained.

MACHINE LEARNING-SCIENCE AND TECHNOLOGY (2021)

Article Physics, Multidisciplinary

Topological Quantum Compiling with Reinforcement Learning

Yuan-Hang Zhang et al.

PHYSICAL REVIEW LETTERS (2020)

Article Multidisciplinary Sciences

Autonomous navigation of stratospheric balloons using reinforcement learning

Marc G. Bellemare et al.

NATURE (2020)

Review Physics, Nuclear

Sample-efficient reinforcement learning for CERN accelerator control

Verena Kain et al.

PHYSICAL REVIEW ACCELERATORS AND BEAMS (2020)

Article Quantum Science & Technology

Universal quantum control through deep reinforcement learning

Murphy Yuezhen Niu et al.

NPJ QUANTUM INFORMATION (2019)

Article Optics

Deep reinforcement learning for coherent beam combining applications

Henrik Tunnermann et al.

OPTICS EXPRESS (2019)

Article Quantum Science & Technology

Entanglement stabilization using ancilla-based parity detection and real-time feedback in superconducting circuits

Christian Kraglund Andersen et al.

NPJ QUANTUM INFORMATION (2019)

Review Physics, Multidisciplinary

Machine learning and the physical sciences

Giuseppe Carleo et al.

REVIEWS OF MODERN PHYSICS (2019)

Article Quantum Science & Technology

Optimizing Quantum Error Correction Codes with Reinforcement Learning

Hendrik Poulsen Nautrup et al.

QUANTUM (2019)

Article Multidisciplinary Sciences

Deterministic teleportation of a quantum gate between two logical qubits

Kevin S. Chou et al.

NATURE (2018)

Article Physics, Multidisciplinary

Fast and Unconditional All-Microwave Reset of a Superconducting Qubit

P. Magnard et al.

PHYSICAL REVIEW LETTERS (2018)

Article Multidisciplinary Sciences

Repeated multi-qubit readout and feedback with a mixed-species trapped-ion register

V. Negnevitsky et al.

NATURE (2018)

Review Physics, Multidisciplinary

Quantum feedback: Theory, experiments, and applications

Jing Zhang et al.

PHYSICS REPORTS-REVIEW SECTION OF PHYSICS LETTERS (2017)

Article Physics, Applied

Rapid High-Fidelity Single-Shot Dispersive Readout of Superconducting Qubits

T. Walter et al.

PHYSICAL REVIEW APPLIED (2017)

Article Multidisciplinary Sciences

Quantum dynamics of simultaneously measured non-commuting observables

Shay Hacohen-Gourgy et al.

NATURE (2016)

Article Multidisciplinary Sciences

Mastering the game of Go with deep neural networks and tree search

David Silver et al.

NATURE (2016)

Article Physics, Multidisciplinary

Machine Learning for Discriminating Quantum Measurement Trajectories and Improving Readout

Easwar Magesan et al.

PHYSICAL REVIEW LETTERS (2015)

Article Computer Science, Artificial Intelligence

Fidelity-Based Probabilistic Q-Learning for Control of Quantum Systems

Chunlin Chen et al.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2014)

Review Robotics

Reinforcement learning in robotics: A survey

Jens Kober et al.

INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH (2013)

Article Multidisciplinary Sciences

Deterministic quantum teleportation with feed-forward in a solid state system

L. Steffen et al.

NATURE (2013)

Article Physics, Multidisciplinary

Feedback Control of a Solid-State Qubit Using High-Fidelity Projective Measurement

D. Riste et al.

PHYSICAL REVIEW LETTERS (2012)

Article Physics, Multidisciplinary

Approaching unit visibility for control of a superconducting qubit with dispersive readout

A Wallraff et al.

PHYSICAL REVIEW LETTERS (2005)