DeepSeek open-sources DeepInfer, the inference framework behind its production services

Chinese artificial intelligence startup Hangzhou DeepSeek Artificial Intelligence Basic Technology Research Co. today open-sourced DeepInfer, the inference framework behind its own production services. The release takes on the cost of serving large models to the public.