Magnetic order and paramagnetic phases in the quantum J1-J2-J3 honeycomb model

Recent work shows that a quantum spin liquid can arise in realistic fermionic models on a honeycomb lattice. We study the quantum spin-1/2 Heisenberg honeycomb model, considering couplings J(1), J(2), and J(3) up to third nearest neighbors. We use an unbiased pseudofermion functional renormalization-group method to compute the magnetic susceptibility and to determine the ordered and disordered states of the model. Aside from antiferromagnetic-, collinear-, and spiral-order domains, we find a large paramagnetic region at intermediate J(2) coupling. For larger J(2) within this domain, we find a strong tendency for staggered dimer ordering, while the remaining paramagnetic regime for low J(2) shows only weak plaquette and staggered dimer responses. We suggest this regime to be a promising region for looking for quantum spin-liquid states when charge fluctuations would be included.