OpenAI President Greg Brockman on new chip: This is a real performance improvement
Speakers
Hock Tan
— CEO, Broadcom
Greg Brockman
— President and Co-Founder, OpenAI
Summary
OpenAI President Greg Brockman and Broadcom CEO Hock Tan discuss their debut custom chip, Jalapeño, designed for LLM inference. Brockman highlights significant performance-per-watt improvements and rapid nine-month design-to-tapeout timeline. Hock Tan says the chip validates Broadcom's business model of building custom AI silicon for frontier model makers. The conversation touches on industry demand for compute and the chip's unique niche.
- OpenAI and Broadcom unveil custom chip Jalapeño for LLM inference.
- Chip targets substantial improvement in performance per watt and per dollar.
- Design to tape out completed in just nine months, described as blazing fast.
- Hock Tan says this validates Broadcom's custom AI silicon business model.
- Chip is built around OpenAI's knowledge of LLM workloads and industry trends.
- Detailed technical benchmark reports promised in the coming months.
Ideas
Broadcom custom AI chip model validated.
The successful debut of OpenAI's custom Jalapeño chip, designed for LLM inference from the ground up and taped out in only nine months, validates Broadcom's business model of partnering with frontier model developers to build their own custom AI silicon. This indicates strong future demand for Broadcom's custom chip design services and reinforces its leading position in the AI silicon ecosystem.
