Modal
Run Python in the cloud without touching infrastructure
3 comments
About Modal
Modal runs Python functions on cloud CPUs and GPUs by adding a decorator. Containers are defined in Python rather than a Dockerfile, cold starts are unusually quick, and you are billed by the second, which suits batch jobs and model inference.
Comments (3)
- Isaac S.5mo ago
The failure mode to watch: Defining the container in python instead of a dockerfile felt wrong for a day and then felt obviously correct...
- nullrichter4mo ago
cold starts on gpu are much faster than the alternatives i tested.
- Sasha P.3mo ago
Per second billing is the right model for batch work. We run nightly jobs for pennies.
Sign in to leave a comment.
