Revolut advances financial AI with foundation model. Researchers have developed PRAGMA, a transformer-based foundation model designed to process vast banking event sequences and transactional data. The model uses self-supervised learning on heterogeneous financial records to create powerful embeddings for downstream applications. PRAGMA demonstrates superior performance across critical financial services including credit scoring, fraud detection, and customer lifetime value prediction. The approach enables financial institutions to extract economic signals from raw transaction data more effectively. By training simple linear models on extracted embeddings, organizations can achieve strong results with minimal computational overhead. This advancement represents a significant step toward more sophisticated AI applications in banking and financial services infrastructure.
![[2604.08649] PRAGMA: Revolut Foundation Model](https://media.fidenly.com/post/images/arxiv-logo-fb.webp)