OpenAI on Thursday unveiled its first custom-designed artificial intelligence (AI) accelerator called Jalapeno. It has been developed in collaboration with California-based semiconductor giant Broadcom. Instead of training, the San Francisco-based company describes it as an “Intelligence Processor” that is purpose-built for large language model (LLM) inference. It is claimed to deliver better performance per watt than current state-of-the-art solutions around the compute, memory, and networking requirements.
from Gadgets 360 https://ift.tt/Sd6w2PA