TAG COLLECTION

Serverless GPU collection

Explore providers, articles, and companies related to Serverless GPU for practical research and comparison.

3 Providers 0 Articles 0 Companies

Providers

3 results

Modal

United States

Modal turns Python functions into GPU workloads with a decorator and 0 orchestration config, targeting 1 second cold starts with per-second billing that scales to zero, plus queues, schedules and distributed maps for batch pipelines and weight caching; abstraction limits and long-run costs are the gaps.

fal

United States

fal serves hundreds of generative models through ready APIs in 1 line of code, targeting 1 second diffusion latency, with custom model deployment, queue and streaming as 2 call modes and GPU-time billing that scales across replicas; thin Chinese ecosystem support is the gap.

Baseten

United States

Baseten packages models with Truss and deploys in 1 click with reproducible configs, autoscaling to zero, inference performance tooling, multi-model pipelines plus logs and 1-click rollback; private deployment discussions and unfriendly low-frequency pricing are the gaps.

Related tags