Federated Learning
Machine Learning

Federated learning-based protein language models with Apheris on AWS

In collaboration with AWS, we implemented FRA-LoRA (Full Rank Aggregation of Low-Rank Adapters) in a federated setting to fine-tune ESM-2 across multiple sites, all without sharing raw data. LoRA reduced trainable parameters to <2% of the original model, cutting communication overhead while preserving accuracy.

Read the article: https://aws.amazon.com/blogs/industries/federated-learning-based-protein-language-models-with-apheris-on-aws/

References

AWS
Share article on LinkedIn

NEWSLETTER

Read past editions on LinkedIn