Many consider moral decisions to follow an internal "moral compass", resistant to social pressures. Here we examine how social influence shapes moral decisions under risk, and how it operates in different decision contexts. We employed an adapted Asian Disease Paradigm where participants chose between certain losses/gains and probabilistic losses/gains in a series of moral (lives) or financial (money) decisions. We assessed participants' own risk preferences before and after exposing them to social norms that are generally risk-averse or risk-seeking. Our results showed that participants robustly shifted their own choices towards the observed risk preferences. This conformity holds even after a re-testing in three days. Interestingly, in the monetary domain, risk-averse norms have more influence on choices in the loss frame, whereas risk-seeking norms have more influence in the gain frame, presumably because norms that contradict default behavior are most informative. In the moral domain, risk-averse as opposed to risk-seeking norms are more effective in the loss frame but in the gain frame different norms are equally effective. Taken together, our results demonstrate conformity in risk preferences across contexts and highlight unique features of decisions and conformity in moral and monetary domains.