cpu only endpoints#751

dmchoiboi wants to merge 4 commits intomainscaleapi/llm-engine:mainfrom

feature/cpu-only-endpointsscaleapi/llm-engine:feature/cpu-only-endpointsCopy head branch name to clipboard