A hydrogen-filled capillary discharge waveguide operating at kHz repetition rates is presented for parameters relevant to laser plasma acceleration (LPA). The discharge current pulse was optimized for erosion mitigation with laser guiding experiments and MHD simulation. Heat flow simulations and measurements showed modest temperature rise at the capillary wall due to the average heat load at kHz repetition rates with water-cooled capillaries, which is promising for applications of LPAs such as high average power radiation sources.