Sail

Sail runs Doom on DataFusion with a single query

Sail is a Spark-compatible compute engine written in Rust on Apache DataFusion: PySpark and Spark SQL clients connect to it over Spark Connect, and DataFusion executes what they send. This week Sail played Doom. Freedoom's first level, 1,200 tics of it, ran as one SQL query:

rust

Nutmeg 0.1.0: graph algorithms where the data already is

Grust's graph kernels inside Sail's Spark Connect server: stage a graph from a DataFrame, call an algorithm, get a DataFrame back.