Criminological theories have posited that the built environment impacts where crime occurs; however, measuring the built environment is difficult. Furthermore, it is uncertain whether the built environment differentially impacts crime in high-disadvantage neighborhoods. This study extracts features of the built environment from Google Street View images with a machine learning semantic segmentation strategy to create measures of fences, walls, buildings, and greenspace for over 66,000 street segments in Los Angeles. Results indicate that the presence of more buildings on a segment was associated with higher crime rates and had a particularly strong positive relationship with robbery and motor vehicle theft in low-disadvantage neighborhoods. Notably, fences and walls exhibited different relationships with crime. Walls, which do not allow visibility, were strongly negatively related to crime, particularly for robbery and burglary in high-disadvantage neighborhoods. Fences, which allow visibility, were associated with fewer robberies and larcenies, but more burglaries and aggravated assaults. Fences only exhibited a negative relationship with violent crime when they were located in low-disadvantage neighborhoods. The results highlight the importance of accounting for the built environment and the surrounding level of disadvantage when exploring the micro-location of crime.