Official Site |
Docs |
Blog |
Roadmap |
MCP Server QuickStart |
Developer Guide |
Wasm Plugin Hub |
What is Higress?
Higress is a cloud-native API gateway based on Istio and Envoy, which can be extended with Wasm plugins written in Go/Rust/JS. It provides dozens of ready-to-use general-purpose plugins and an out-of-the-box console (try the demo here).
Core Use Cases
Higress's AI gateway capabilities support all mainstream model providers both domestic and international. It also supports hosting MCP (Model Context Protocol) Servers through its plugin mechanism, enabling AI Agents to easily call various tools and services. With the openapi-to-mcp tool, you can quickly convert OpenAPI specifications into remote MCP servers for hosting. Higress provides unified management for both LLM API and MCP API.
🌟 Try it now at https://mcp.higress.ai/ to experience Higress-hosted Remote MCP Servers firsthand:
Production Adoption
Higress originated at Alibaba to address long-connection disruption during
gateway reloads and improve gRPC/Dubbo load balancing. It is now developed as
a vendor-neutral CNCF project and is used by organizations across multiple
industries. Public adopters and their use cases are listed in
ADOPTERS.md.
Summary
Use Cases
-
MCP Server Hosting:
Higress hosts MCP Servers through its plugin mechanism, enabling AI Agents to easily call various tools and services. With the openapi-to-mcp tool, you can quickly convert OpenAPI specifications into remote MCP servers.
Key benefits of hosting MCP Servers with Higress:
-
Unified authentication and authorization mechanisms
-
Fine-grained rate limiting to prevent abuse
-
Comprehensive audit logs for all tool calls
-
Rich observability for monitoring performance
-
Simplified deployment through Higress's plugin mechanism
-
Dynamic updates without disruption or connection drops
Learn more...
-
AI Gateway:
Higress connects to all LLM model providers using a unified protocol, with AI observability, multi-model load balancing, token rate limiting, and caching capabilities:
Higress is also listed as a conformant Gateway API Inference Extension implementation, supporting inference-aware routing on Kubernetes.
-
Kubernetes ingress controller:
Higress can function as a feature-rich ingress controller and is listed in the official Kubernetes Ingress Controllers documentation. It is compatible with many annotations of the Kubernetes NGINX Ingress Controller.
Higress supports the Gateway API standard and is listed as a , enabling smooth migration from the Ingress API to the Gateway API.
Core Advantages
-
Production Grade
Born from Alibaba's internal product with over 2 years of production validation, supporting large-scale scenarios with hundreds of thousands of requests per second.
Completely eliminates traffic jitter caused by Nginx reload, configuration changes take effect in milliseconds and are transparent to business. Especially friendly to long-connection scenarios such as AI businesses.
-
Streaming Processing
Supports true complete streaming processing of request/response bodies, Wasm plugins can easily customize the handling of streaming protocols such as SSE (Server-Sent Events).
In high-bandwidth scenarios such as AI businesses, it can significantly reduce memory overhead.
-
Easy to Extend
Provides a rich official plugin library covering AI, traffic management, security protection and other common functions, meeting more than 90% of business scenario requirements.
Focuses on Wasm plugin extensions, ensuring memory safety through sandbox isolation, supporting multiple programming languages, allowing plugin versions to be upgraded independently, and achieving traffic-lossless hot updates of gateway logic.
-
Secure and Easy to Use
Based on Ingress API and Gateway API standards, provides out-of-the-box UI console, WAF protection plugin, IP/Cookie CC protection plugin ready to use.
Supports connecting to Let's Encrypt for automatic issuance and renewal of free certificates, and can be deployed outside of K8s, started with a single Docker command, convenient for individual developers to use.
Community
Join our Discord community! This is where you can connect with developers and other enthusiastic users of Higress.
Join the monthly Higress Community Meeting for public project
updates, technical discussions, roadmap planning, and community questions.
The complete inventory of public and private communication channels,
subproject channels, meeting information, and contributor activity is in
COMMUNITY.md.
Code of Conduct
The Higress community follows the
CNCF Code of Conduct.
The project's adopted Code of Conduct is documented in
CODE_OF_CONDUCT.md.
Please review it before
participating in the community.
Governance & Maintainers
Project governance, the maintainer roster, and the contribution model are
described in GOVERNANCE.md
and MAINTAINERS.md.
New contributors are encouraged to start
with CONTRIBUTING_EN.md. Forward planning and release
procedures are documented in ROADMAP.md
and
RELEASE.md.
Security
Please report security vulnerabilities following the process described in
SECURITY.md.
Thanks
Higress would not be possible without the valuable open-source work of projects in the community. We would like to extend a special thank you to Envoy and Istio.
Related Repositories
Contributors
Star History
Cloud Native Computing Foundation
We are a Cloud Native Computing Foundation sandbox project.
The Linux Foundation® (TLF) has registered trademarks and uses trademarks. For
a list of TLF trademarks, see Trademark Usage.
Copyright Higress a Series of LF Projects, LLC. For website terms of use,
trademark policy and other project policies please see
https://lfprojects.org/policies/.