Amazon’s Exabyte-Scale Migration from Apache Spark to Ray on Amazon EC2
July 25, 2024Large-scale, distributed compute framework migrations are not for the faint of heart. There are backwards-compatibility constraints to maintain, performance expectations to meet, scalability limits to overcome, and the omnipresent risk of introducing breaking changes to production. This all becomes especially troubling if you happen to…