Modal is a serverless platform, offering GPU capacities on hour or second based usage.
Great for inference or training on a GPU.
Install the client with: pip install modal.
Calling functions
API Keys & Auth
Pricing
Nvidia A100, 40 GB of VRAM:
Etc.
Notebooks keep running until the time out automatically - thus, be aware of running cost when using notebooks, even though you are not actively using them.