Amplification of chromosome 20q is frequently found in various types of human cancers, including breast cancer. The list of candidate oncogenes in 20q has expanded over the past decade. Here, we investigate whether FAM83D (family with sequence similarity 83, member D) on chromosome 20q plays any role in breast cancer development. The expression level of FAM83D is significantly elevated in breast cancer cell lines and primary human breast cancers. High expression levels of FAM83D are significantly associated with poor clinical outcome and distant metastasis in breast cancer patients. We show that ectopic expression of FAM83D in human mammary epithelial cells promotes cell proliferation, migration and invasion along with epithelial-mesenchymal transition (EMT). Ablation of FAM83D in breast cancer cells induces apoptosis and consequently inhibits cell proliferation and colony formation. Mechanistic studies reveal that overexpression of FAM83D downregulates FBXW7 expression levels through a physical interaction, which results in elevated protein levels of oncogenic substrates downstream to FBXW7, such as mTOR, whose inhibition by rapamycin can suppress FAM83D-induced cell migration and invasion. The results demonstrate that FAM83D has prognostic value for breast cancer patients and is a novel oncogene in breast cancer development that at least in part acts through mTOR hyper-activation by inhibiting FBXW7.