🧠 Neural Processing Architecture

Powered by cutting-edge AI technologies including Encoder Only Models, SLMs and LLMs, and advanced semantic understanding for intelligent model routing and selection.

🤖Small Language Models

🧬Neural Network Processing

⚡Real-time Inference

🎯Semantic Understanding

Neural Processing UnitEmbedding • Classify • Similarity

🏗️ Architecture

🎯 Our Goals

Building the System Level Intelligence for Mixture-of-Models (MoM), bringing Collective Intelligence into LLM systems

How to capture the missing signals in request, response and context?

How to combine the signals to make better decisions?

How to collaborate more efficiently between different models?

How to secure the real world and LLM system from jailbreaks, pii leaks, hallucinations?

How to collect the valuable signals and build a self-learning system?

📍 Where it lives

It lives between the real world and models

👥 Meet Our Team

The amazing people behind vLLM Semantic Router

Maintainer

Huamin Chen

Distinguished Engineer @Red Hat

Maintainer

Chen Wang

Senior Staff Research Scientist @IBM

Maintainer

Yue Zhu

Staff Research Scientist @IBM

Maintainer

Xunzhuo Liu

AI Networking @Tencent

Committer

Senan Zedan

R&D Manager @Red Hat

Committer

samzong

AI Infrastructure / Cloud-Native PM @DaoCloud

Committer

Liav Weiss

Software Engineer @Red Hat

Committer

Asaad Balum

Senior Software Engineer @Red Hat

Committer

Yehudit

Software Engineer @Red Hat

Committer

Noa Limoy

Software Engineer @Red Hat

Committer

JaredforReal

Software Engineer @Z.ai

Committer

Srinivas A

Software Engineer @Yokogawa

Committer

carlory

Open Source Engineer @DaoCloud

Committer

Yossi Ovadia

Senior Principal Engineer @Red Hat

Committer

Jintao Zhang

Senior Software Engineer @Kong

Committer

yuluo-yx

Individual Contributor

Committer

cryo-zd

Individual Contributor

Committer

OneZero-Y

Individual Contributor

Committer