am-i-openai-compatible: tool for unified API signatures in open-source AI
Use am‑i‑openai‑compatible to verify and document API signatures of open‑source LLMs.
Integrate am‑i‑openai‑compatible into your API compatibility checks and contribute to its documentation.
Summary
A new tool and documentation page called am‑i‑openai‑compatible was created to document the adherence of major open‑source LLM projects to OpenAI‑compatible API signatures. The tool covers engines such as vLLM and llama.cpp, and also provides ht‑compatibility for other model types. The documentation includes both official and unofficial signatures, and the author plans to add Anthropic compatibility as an optional extension. The project is hosted on GitHub and has Readthedocs documentation. The tool is intended to simplify the integration of LLMs into applications and to aid developers building proxies or middleware.
The release offers a standardized reference for API compatibility, making it easier to switch between open‑source engines without rewriting client code.
Key changes
- Tool created to document OpenAI compatibility signatures
- Supports vLLM and llama.cpp
- Includes ht‑compatibility for other model types
- GitHub repo and Readthedocs available
- Future extension for Anthropic compatibility planned
- Facilitates proxy/middleware development