OpenAI and Broadcom Name Jalapeño, a Custom Chip Built for LLM Inference
OpenAI and Broadcom have introduced Jalapeño, a custom LLM inference processor. The useful question is how much of the AI serving stack moves toward tuned silicon, and what remains unknown.
OpenAI and Broadcom Name Jalapeño, a Custom Chip Built for LLM Inference Read More