Non-HACEK Gram-negative bacilli account for only a small percentage of infective endocarditis cases globally. Among those, Klebsiella species account for only about 10% of cases and are most often health-care acquired. We present a rare case of Klebsiella oxytoca endocarditis in a young intravenous drug user.