Astrocytes are vital support cells that ensure proper brain function. In brain disease, astrocytes reprogram into a reactive state that alters many of their cellular roles. A long-standing question in the field is whether downregulation of reactive astrocyte (RA) markers during resolution of inflammation is because these astrocytes revert back to a non-reactive state or die and are replaced. This has proven difficult to answer mainly because existing genetic tools cannot distinguish between healthy versus RAs. Here we describe the generation of an inducible genetic tool that can be used to specifically target and label a subset of RAs. Longitudinal analysis of an acute inflammation model using this tool revealed that the previously observed downregulation of RA markers after inflammation is likely due to changes in gene expression and not because of cell death. Our findings suggest that cellular changes associated with astrogliosis after acute inflammation are largely reversible.