E2E Networks launches pay-per-token AI inference service in India

https://cdn1.expresscomputer.in/wp-content/uploads/2025/11/24153352/EC_05_Artificial_Intelligence_AI_Technology_750.jpg

E2E Networks has launched Blaze, a pay-per-token inference service for open AI models, offering developers and enterprises a single OpenAI-compatible API to access models including NVIDIA Nemotron, Sarvam, DeepSeek, Qwen, GLM and Gemma.

The service runs on NVIDIA GPU infrastructure in India and uses components from NVIDIA DSX OS. E2E manages model hosting and scaling, with customers charged according to token usage. The company said Blaze is designed for inference-heavy applications such as coding agents, voice, document AI, OCR and image and video generation.

Blaze uses NVIDIA Dynamo for distributed model serving, with features including KV-cache-aware routing and separate prefill and decode processing. NVIDIA Grove and KAI Scheduler coordinate workloads across E2E’s Kubernetes infrastructure, while NVIDIA BlueField DPUs and related software are used to isolate customer workloads.

E2E said Blaze is intended to address demand for lower-latency inference and India-hosted compute as businesses move AI applications from pilots into production....

Copyright of this story solely belongs to www.expresscomputer.in. To see the full text click HERE

Read more