WHY IT MATTERS: Digital Transformation
181.1K views | +2 today
Follow
WHY IT MATTERS: Digital Transformation
Get weekly or monthly digest of all posts in your inbox: https://fmcs.digital/wim-subscribe
Curated by Farid Mheir
Your new post is loading...
Scooped by Farid Mheir
Scoop.it!

System Creates the Illusion of an Ideal AI Chip and offers an alternative to @Cerebras wafer-scale integration - more #AI good news via @IEEESpectrum

System Creates the Illusion of an Ideal AI Chip and offers an alternative to @Cerebras wafer-scale integration - more #AI good news via @IEEESpectrum | WHY IT MATTERS: Digital Transformation | Scoop.it

Called Illusion, it uses processors built with resistive RAM memory in a 3D stack built above the silicon logic, so it costs little energy or time to fetch data. By itself, even this isn’t enough, because neural networks are increasingly too large to fit in one chip. So the scheme also requires multiple such hybrid processors and an algorithm that both intelligently slices up the network among the processors and also knows when to rapidly turn processors off when they’re idle.

Farid Mheir's insight:

WHY IT MATTERS: not sure how practical this system is but sure seems easier to manufacture than Cerebras wafer-scale solution. No matter what architecture wins, we can see that there will be computer designs that will maximize neural net with billions of nodes (GPT3 has 175B) training. 

See also cerebras link: http://blog.fmcs.digital/?q=cerebras

No comment yet.
Scooped by Farid Mheir
Scoop.it!

5 technical challenges Cerebras overcame in building the first trillion-transistor chip highlights the state of the art in silicon fabrication & advances we can expect in #machineLearning and #AI i...

5 technical challenges Cerebras overcame in building the first trillion-transistor chip highlights the state of the art in silicon fabrication & advances we can expect in #machineLearning and #AI i... | WHY IT MATTERS: Digital Transformation | Scoop.it

Superlatives abound at Cerebras, the until-today stealthy next-generation silicon chip company looking to make training a deep learning model as quick as buying toothpaste from Amazon. Launching after almost three years of quiet development, Cerebras introduced its new chip today — and it is a doozy.

Farid Mheir's insight:

WHY IT MATTERS: this is a BIG deal in hardware design. Being able to fabricate such a large system enables capabilities to a scale previously unheard of. Read this article for a high level overview, watch the next blog post for an in depth description.

No comment yet.
Curated by Farid Mheir
Get every post weekly in your inbox by registering here: http://fmcs.digital/newsletter-signup/