TAG COLLECTION

GPU Inference collection

Explore providers, articles, and companies related to GPU Inference for practical research and comparison.

2 Providers 1 Articles 0 Companies

Providers

2 results

NVIDIA NIM

United States

NVIDIA NIM packages models as containerised microservices exposing a standard API from 1 image, optimised with TensorRT for several times the throughput, privately deployable and covering 4 model families; GPU requirements, licensing and heavier onboarding are the gaps.

DeepInfra

United States

DeepInfra hosts open-weight models on per-token pricing behind an OpenAI-compatible endpoint where migration replaces 1 base_url, covering 4 families in chat, embeddings, reranking and images with serverless elasticity or dedicated instances; the gaps are no closed flagship and cold-start latency.

Articles

1 results

Related tags