Orthrus: Towards Evolutionary and Functional RNA Foundation Models

Orthrus is a mature RNA model for RNA property prediction. It uses a Mamba encoder backbone, a variant of state-space models specifically designed for long-sequence data, such as RNA. Two versions of Orthrus are available: 4-track base version: Encodes the mRNA sequence with a simplified one-hot approach. 6-track large version: Adds biological context by including splice site indicators and coding sequence markers, which is crucial for accurate mRNA property prediction such as RNA half-life, ribosome load, and exon junction detection.