I threw 1000+ LLM calls. Here is how VernLLM handled it.

VernLLM: A Framework for LLM Calls in TypeScript

VernLLM is the LLM call framework for TypeScript. This video tests out its features, which includes adaptive AIMD rate-limiting, advanced circuit-breakers, multi provider fallbacks, developed retries with budget and observability.

Features and Licensing

VernLLM is open source with an MIT license. You can find more information on the following websites:

• Website: https://vernllm.dev
• GitHub: https://github.com/LakBud/vernLLM
• npm: https://www.npmjs.com/package/vern-llm

Testing the Framework

This test is using a mock AI provider with a 70% guaranteed failure rate. This is because using 1000+ LLM calls with an actual AI provider isn't needed to actually test out its features, and it's also expensive.