Snowflake targets AI costs with dynamic model routing
Snowflake is expanding its AI infrastructure proposition with dynamic model routing, designed to help enterprises control the economics of AI by automatically matching workloads with models based on quality, speed, customer preferences and cost.
The capability is being introduced through Cortex AI Gateway and Snowflake’s AI products, including Snowflake CoCo and Snowflake CoWork. It can also be used by third-party AI agents connected through Cortex AI Gateway.
The move comes as enterprises deploy a growing mix of AI applications and agents. Using a frontier model for every task can increase inference costs, while manually selecting and managing models for different workloads adds operational complexity.
Dynamic model routing is intended to address both problems. Lower-complexity or repetitive tasks can be directed towards more efficient models, while workloads requiring deeper reasoning can be routed to frontier models. Snowflake said this allows customers to reduce unnecessary inference spending without having to determine the...
Copyright of this story solely belongs to expresscomputer.in. To see the full text click HERE
