GenePT Revisited: Do Better Text Embeddings Make Better Gene Embeddings?
Discuss this preprint
Start a discussion What are Sciety discussions?Listed in
This article is not in any list yet, why not save it to one of your lists.Abstract
GenePT introduced a simple recipe for gene representations: embed each gene’s natural-language description with a general-purpose text embedding model and reuse the resulting vectors across downstream tasks. Since GenePT’s release, embedding models have improved rapidly, with many strong open and commercial encoders benchmarked on suites such as the Massive Text Embedding Benchmark (MTEB). We present a controlled “leaderboard” study that keeps the GenePT pipeline fixed and varies only the embedding backbone. We benchmark contemporary encoders on four diverse gene embedding tasks: gene–gene interaction prediction, gene property classification, cell type classification, and prediction of transcriptomic responses to unseen genetic perturbations. Across these settings, newer backbones consistently outperform the original GenePT backbone ( text-embedding-ada-002 ), achieving improvements of 1–17%, while enabling fully reproducible research by avoiding API dependencies.