Understanding the Compute Hardware Behind Generative AI

搜索最新SoC解决方案
关于汽车电子...物联网...安全...音频...视频

Generative AI tools like ChatGPT have had a huge impact in numerous sectors of society. As engineers, it's helpful for us to understand the computing technology that makes it possible.

www.allaboutcircuits.com/, Aug. 10, 2023 – 

Artificial intelligence has made significant leaps forward in recent years as new technologies emerge at an unprecedented rate. There's no doubt that tools like ChatGPT, Bard, and Einstein will impact industries across the board–from media and content creation to research, finance and beyond.

These tools can now closely simulate human conversation, with the ability to comprehend contextual information, converse in real-time, and execute tasks from translating to summarizing with remarkable precision.

To give a sense of the speed at which these AI technologies have advanced, "the amount of compute used on the largest AI training runs has been increasing exponentially with a 3.4-month double time," according to OpenAI. Looking back to the 80s and 90s, an era when neural networks saw intense research activity, compute and memory for training engines were incredibly weak compared to today's capabilities.

Flash forward to 2012, and the relentless progression of Moore's Law enabled AI to efficiently perform classification–identifying objects in pictures and video. At the same time, the development of natural language processing (NLP) was vitally important.

As tools like Siri began to take off, slowly developing and evolving with these applications, the obvious next step was getting them to generate. Once these training algorithms could quickly classify information, make correlations between data, and understand requests made, the question became whether they could utilize those learnings to efficiently assemble new content in a recognizable way.

Thanks to the semiconductor industry's advancements in HBM (high-bandwidth memory), DDR, heterogeneous computing, and more, that has become reality as we enter the beginning of a new era of generative AI.

click here to read more...

 Back