Introduction to Ray

Distributed Compute

I’ve wanted to look into this for a long time. Time flies, too much going on, never have time. I heard about Ray many moons ago, heard nothing for years, then when LLMs started to become a thing, pop goes the weasel, there was Ray again.

I thought that thing curled up in a corner and wilted away to nothing. Guess I was wrong.

A few days ago when I was wondering when something interesting would come across my feed, something besides the same old data modeling, Python, or Spark cruddy crud … I saw a blurb about Databricks support for Ray Clusters and workloads.

I figure if Databricks is working on Ray, I should probably pay attention, and you too for that matter.

Introduction to Ray

Let’s start by getting a high-level overview of what Ray is, what it is used for, and why you should care about it.