Colorectal cancer (CRC) is the third most common cancer in the USA and worldwide. In the USA, nearly one-third of CRC cases are anatomically classified as rectal cancer. Over the past few decades, continued refinement of multimodality treatment and the introduction of new therapeutic agents have enhanced curative treatment rates and quality of life outcomes. As treatments improve and the incidence of young onset rectal cancer rises, the number of rectal cancer survivors grows each year. This trend highlights the growing importance of rectal cancer survivorship. Multimodality therapy with systemic chemotherapy, chemoradiation, and surgery can result in chronic toxicities in multiple organ systems, requiring a multi-disciplinary care model with services ranging from appropriate cancer surveillance to management of long-term toxicities and optimization of modifiable risk factors. Here, we review the evidence on these long-term toxicities and provide management considerations from consensus guidelines. Specific topics include bowel dysfunction from radiation and surgery, oxaliplatin-induced neuropathy, accelerated bone degeneration, the impact of fluoropyrimidines on long-term cardiovascular health, urinary incontinence, sexual dysfunction, and psychosocial distress. Additionally, we review modifiable risk factors to inform providers and rectal cancer survivors of various lifestyle and behavioral changes that can be made to improve their long-term health outcomes.