Product
9 Interestana reports mention vLLM, newest first. Each is summarised from the original reporting and links back to its publisher.
A critical vulnerability has been identified in LMCache, an open-source software component designed to accelerate large language model (LLM) servers, including popular frameworks like vLLM. This flaw, designated as a critical security issue, permits unauthenticated attackers to execute arbitrary code…
Prime Intellect has launched Prime Inference, a new serving platform designed for frontier open-source artificial intelligence models. This platform provides users with both serverless endpoints and reserved capacity, leveraging Prime Intellect's own Graphics Processing Units (GPUs) distributed across multiple datacenters.
Aikido Security has released Altar-1, its inaugural open-weight security model, on March 14, 2024. This model is a compressed iteration of Z.AI's GLM-5.3, engineered for deployment within customer-controlled infrastructure. Altar-1 serves as the foundational technology for Aikido Machine, the company's…
Contrastive-LM has released CLM-8B, marking the debut of the first open model in a new category termed Contrastive Language Models (CLMs). Unlike traditional language models that generate text, CLM-8B is designed to score a set of candidate actions…
The Institute of Foundation Models (IFM), a frontier research lab established by MBZUAI in May 2025, has released K2 Horizon, a comprehensive suite of six open-source large language models. This release, described by IFM as the largest fully open-source model…
NVIDIA has released Switchyard, an experimental proxy and library written in Rust, designed to address the challenge of integrating different Large Language Model (LLM) APIs within coding agent workflows. Teams developing coding agents often encounter difficulties when different models…
Mistral AI has released Shieldstral 1.0 3B, an open-weights, policy-adaptive multimodal safety classifier designed to handle content moderation by framing it as a single yes/no question rather than relying on a predefined taxonomy of harm categories.
A German research consortium has published the pretraining report for Soofi S 30B-A3B, an open base model designed for German and English language tasks. The model was trained end-to-end on Deutsche Telekom’s Industrial AI Cloud in Munich, with preview weights…
vLLM released its new modeling backend on May 15, 2024, engineered for native-speed inference of transformer models. This development targets the critical need for efficient processing of large language models (LLMs) in real-time applications.