dstack

dstack is an open-source toolkit for running llm workloads across any clouds, offering a cost-efficient and user-friendly interface for training, inference, and development.