












Shubham Malhotra
CTO at RunAnywhere
I'm co-founder and CTO of RunAnywhere. Inference research at the frontier: we make frontier open models faster and cheaper on Wally. I lead our engine research: trnRT for AWS Trainium, MetalRT for Apple silicon (658 tok/s decode on M4 Max) and QHexRT for Hexagon NPUs. Before this I worked on EC2 Spot at AWS and Azure Arc at Microsoft, and I'm a peer-reviewed researcher. trnRT is open source: https://github.com/RunanywhereAI/trnrt
Follow Shubham
Previously at

Amazon Web Services (AWS)

Microsoft
RIT MAGIC

Salesforce
Rochester Institute of Technology

Largo Capital, Inc.

E-Solar
Alumnus of
Rochester Institute of Technology
Vellore Institute of Technology