Home › Model Serving › New API

New API - AI Model Serving Tool

Overview

New API is an open-source LLM gateway and AI asset management system that unifies multiple large model APIs (for example, OpenAI and Claude) into a standardized interface. It provides a web UI, multi-language support, usage tracking, token grouping, model charging, and configurable reasoning effort for personal and internal enterprise use.

Key Features

  • Unified interface for multiple LLM providers (e.g., OpenAI, Claude).
  • Standardized API for model serving and asset management.
  • Rich web UI for managing models and configurations.
  • Multi-language support for international deployments.
  • Online recharge and usage tracking capabilities.
  • Token grouping and model charging controls.
  • Configurable reasoning effort per request.

Ideal Use Cases

  • Consolidate multiple LLM providers behind a single API.
  • Internal enterprise gateway with usage monitoring and chargeback.
  • Manage and distribute AI assets across teams.
  • Self-hosted model-serving for personal or internal deployments.

Getting Started

  • Clone the repository from the project's GitHub URL.
  • Read the repository README and configuration examples.
  • Add provider API keys (OpenAI, Claude, or others).
  • Configure token grouping and model charging settings.
  • Start the gateway following repository instructions.
  • Access the web UI to manage models and monitor usage.

Pricing

No pricing information is provided in the project metadata. The project is open-source; hosting or enterprise costs are not disclosed.

Limitations

  • Repository does not include pricing or commercial support details.

Key Information

  • Category: Model Serving
  • Type: AI Model Serving Tool
Visit Official Website

Related Tools

Replicate

Hosted inference platform to run, fine-tune, and deploy AI models via API.
Hugging Face

AI platform and hub for hosting, sharing, and running models, datasets, and apps with enterprise options.
Hugging Face Spaces

A platform for hosting machine learning demo apps with support for GPU acceleration, Docker, and custom Python environments.
HUGS

Optimized, zero‐configuration inference microservices from Hugging Face designed to simplify and accelerate the deployment of open AI models via an OpenAI‐compatible API.
OpenVINO

OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference across various platforms. It supports models trained with popular frameworks and enhances performance for deep learning tasks in computer vision, automatic speech recognition, and natural language processing.
Hugging Face Hub

The official Python client for the Hugging Face Hub, allowing users to interact with pre-trained models and datasets, manage repositories, and run inference on deployed models.