Predicting the risk of liver metastasis can have important prognostic and therapeutic implications, given the availability of liver-directed therapy. Uveal melanoma has a striking predisposition for liver metastasis despite the absence of anatomical proximity. Understanding its biology may uncover factors promoting liver metastasis in other malignancies. We quantified gene expression by RNAseq in 76 uveal melanomas and combined with public data in a meta-analysis of 196 patients. The meta-analysis of uveal melanoma gene expression identified 63 genes which remained prognostic after adjustment for chromosome 3 status. Two genes, PTP4A3 and JPH1, were selected by L1-penalized regression and combined in a prognostic score. The score predicted liver-specific relapse in a public pan-cancer dataset and in two public colorectal cancer datasets. The score varied between colorectal consensus molecular subtypes (CMS), as did the risk of liver relapse, which was lowest in CMS1. Additional prospective validation was done by real-time PCR in 463 breast cancer patients. The score was significantly correlated with liver relapse in hormone receptor positive tumors. In conclusion, the expression of PTP4A3 and JPH1 correlates with risk of liver metastasis in colorectal cancer and breast cancer. The underlying biological mechanism is an interesting area for further research.