The extraordinary properties of the Kitaev model have motivated an intense search for new physics in materials that combine geometrical and bond frustration. In this Letter, we employ inelastic neutron scattering, spin wave theory, and exact diagonalization to study the spin dynamics in the perfect triangular-lattice antiferromagnet (TLAF) CsCeSe2. This material orders into a stripe phase, which is demonstrated to arise as a consequence of the off-diagonal bond-dependent terms in the spin Hamiltonian. By studying the spin dynamics at intermediate fields, we identify an interaction between the single-magnon state and the two-magnon continuum that causes decay of coherent magnon excitations, level repulsion, and transfer of spectral weight to the continuum that are controlled by the strength of the magnetic field. Our results provide a microscopic mechanism for the stabilization of the stripe phase in TLAF and show how complex many-body physics can be present in the spin dynamics in a magnet with strong Kitaev coupling even in an ordered ground state.

The two-dimensional triangular-lattice antiferromagnet (TLAF) is a textbook example of frustrated magnetic systems. Despite its simplicity, the TLAF model exhibits a highly rich and complex magnetic phase diagram, featuring numerous distinct ground states that can be stabilized through frustrated next-nearest-neighbor couplings or anisotropy. In this paper, we report low-temperature magnetic properties of the TLAF material CsCeSe2. The inelastic neutron scattering (INS) together with specific heat measurements and density functional theory calculations of crystalline electric field suggest that the ground state of Ce ions is a Kramers doublet with strong easy-plane anisotropy. Elastic neutron scattering measurements demonstrate the presence of stripe-yz magnetic order that develops below TN=0.35K, with the zero-field ordered moment of mCe≈0.65μB. Application of magnetic field first increases the ordering temperature by about 20% at the intermediate field region and eventually suppresses the stripe order in favor of the field-polarized ferromagnetic state via a continuous quantum phase transition (QPT). The field-induced response demonstrates sizable anisotropy for different in-plane directions, Ba and Ba, which indicates the presence of bond-dependent coupling in the spin Hamiltonian. We further show theoretically that the presence of anisotropic bond-dependent interactions can change the universality class of QPT for Ba and Ba.