Plate IV.116 · Publications

ProCyon: A multimodal foundation model for protein phenotypes

Preprint in bioRxiv, 15 December 2024.

PreprintOpen accessResearch area: Representations, Single Cell

Authors

  1. Owen Queen
  2. Yepeng Huang
  3. Robert Calef
  4. Valentina Giunchiglia
  5. Tianlong Chen
  6. George Dasoulas
  7. LeAnn Tai
  8. Gianmarco Abbadessa
  9. Owain Howell
  10. Michelle M. Li
  11. Yasha Ektefaie
  12. Ayush Noori
  13. Ildiko Farkas
  14. Joseph Brown
  15. Tom Cobley
  16. Karin Hrovatin
  17. Tom Hartvigsen
  18. Fabian J. Theis
  19. Bradley L. Pentelute
  20. James Zou
  21. Vikram Khurana
  22. David Owen
  23. Richard Nicholas
  24. Manolis Kellis
  25. Marinka Zitnik

Abstract

Characterizing human proteins remains a major challenge: approximately 29% of human proteins lack experimentally validated functions and even well-annotated proteins often lack context-specific phenotypic insights. To enable universal modeling of protein phenotypes, we present P ro C yon, a multimodal foundation model that utilizes protein sequence, structure, and natural language for generating and predicting protein phenotypes across diverse knowledge domains. P ro C yon is trained on our novel dataset, P ro C yon -I nstruct, with 33 million protein phenotype instructions. On dozens of benchmarking tasks, P ro C yon performs competitively against single-modal and multimodal models. Further, P ro C yon conditionally retrieves proteins via mechanisms of action of small molecule drugs and disease contexts, and it generates candidate phenotypic descriptions for poorly characterized proteins, including those implicated in Parkinson’s disease that were identified after P ro C yon ’s knowledge cutoff date. We experimentally confirm P ro C yon ’s predictions in multiple sclerosis using post-mortem brain RNA-seq, identifying novel MS genes and elucidating associated pathway mechanisms consistent with cortical pathology. P ro C yon paves the way toward a general approach to generate functional insights into the human proteome.

Cite

@misc{queen2024procyon,
  title = {{ProCyon: A multimodal foundation model for protein phenotypes}},
  author = {Queen, Owen and Huang, Yepeng and Calef, Robert and Giunchiglia, Valentina and Chen, Tianlong and Dasoulas, George and Tai, LeAnn and Abbadessa, Gianmarco and Howell, Owain and Li, Michelle M. and Ektefaie, Yasha and Noori, Ayush and Farkas, Ildiko and Brown, Joseph and Cobley, Tom and Hrovatin, Karin and Hartvigsen, Tom and Theis, Fabian J. and Pentelute, Bradley L. and Zou, James and Khurana, Vikram and Owen, David and Nicholas, Richard and Kellis, Manolis and Zitnik, Marinka},
  howpublished = {bioRxiv},
  publisher = {openRxiv},
  year = {2024},
  month = dec,
  doi = {10.1101/2024.12.10.627665},
  url = {https://doi.org/10.1101/2024.12.10.627665},
  note = {Preprint}
}
.bib file