Meta designed the “Meta Training and Inference Accelerator” which meets demands of deep learning recommender models at inference time. The accelerator is powered by a grid of processing elements where each element contains two RISC-V cores (one of these has a vector extension): https://www.nextplatform.com/2023/05/18/meta-platforms-crafts-homegrown-ai-inference-chip-ai-training-next/

#meta #mtia #dlrm #inference #ai #hpc