Aurko AI-GATEWAY

About

Built an open-source AI proxy gateway in Go (deployed on Railway) designed specifically to kill duplicate token costs for recursive agent loops. Taget is to solve the problem of high token costs and api bills . This alone bankrupts startups and developers. It sits directly between an application and the LLM provider, executing local CPU token-normalized semantic caching to intercept highly repetitive system prompts and sub-loops, serving hits straight from Redis in <1ms. Right now, it's cutting token overhead by 40–70% for heavy agent workloads. It’s completely open-source and ready to run : github.com/Arnab758/ai-gateway