Crimson Hat is introducing a unified AI platform for deploying and managing AI fashions, brokers, and purposes.
Crimson Hat AI Enterprise goals to assist firms which might be caught in AI pilot phases on account of fragmented instruments and infrastructure, by providing a regular atmosphere the place organizations can carry out AI inference, customise and tune fashions, and deploy and handle brokers, utilizing any mannequin or {hardware}.
It leverages optimized runtimes for inference, akin to vLLM and the llm-d framework, to supply high-throughput and low-latency mannequin serving, in addition to offering a standardized API layer through the Llama Stack and supporting the Mannequin Context Protocol (MCP) to permit connection to exterior programs.
Moreover, to allow higher belief in AI, Crimson Hat AI Enterprise affords instruments for drift detection, bias monitoring, and mannequin explainability, together with analysis frameworks like RAGAS, which measure the standard of RAG-based programs.
In line with Crimson Hat, whereas the platform is necessary in laying the foundations for AI implementation, its true energy is in its Day-2 capabilities, akin to dynamic useful resource scaling, built-in monitoring, unified safety, and rolling updates to forestall downtime.
“Crimson Hat AI Enterprise is greater than only a assortment of instruments—it’s a strategic basis for the AI-driven period. By bridging the hole between experimentation and manufacturing, it helps organizations innovate sooner whereas sustaining the safety posture and management required by the trendy enterprise,” Jennifer Vargas, principal product advertising supervisor at Crimson Hat, wrote in a weblog submit.
To coincide with the launch of Crimson Hat AI Enterprise, the corporate additionally introduced a brand new model of Crimson Hat AI, its platform for constructing and working AI purposes.
Crimson Hat AI 3.3 options an expanded mannequin ecosystem that features production-ready, compressed variations of Mistral-Giant-3, Nemotron-Nano, and Apertus-8B-Instruct. It additionally affords help for added {hardware}, akin to help for AMD MI325X accelerators, an enlargement to the {hardware} certification for NVIDIA’s Blackwell Extremely, and a know-how preview for supporting Intel CPUs.
As well as, this launch features a know-how preview of Fashions-as-a-Service (MaaS), enabling IT groups to arrange self-service entry to privately hosted fashions, selling elevated AI adoption inside the enterprise.
Different key updates in Crimson Hat AI 3.3 embrace:
- The Crimson Hat AI Python Index, which supplies entry to enterprise-grade variations of crucial instruments like Docling, SDG Hub, and Coaching Hub
- Actual-time telemetry throughout AI workloads, llm-d deployments, and MaaS cluster and mannequin utilization
- A know-how preview of a NeMo Guardrails integration that enables builders to higher implement operational security and alignment
