filister@lemmy.world to Technology@lemmy.worldEnglish · 1 年前DeepSeek R1 Is Reportedly Running Inference On Huawei's Ascend 910C AI Chips, Showing China's Growing AI Capabilitieswccftech.comexternal-linkmessage-square13linkfedilinkarrow-up1155arrow-down15
arrow-up1150arrow-down1external-linkDeepSeek R1 Is Reportedly Running Inference On Huawei's Ascend 910C AI Chips, Showing China's Growing AI Capabilitieswccftech.comfilister@lemmy.world to Technology@lemmy.worldEnglish · 1 年前message-square13linkfedilink
minus-squareSavvyBeardedFish@reddthat.comlinkfedilinkEnglisharrow-up7·1 年前Yes, so R&D and finalizing the model weight is done on NVIDIA GPUs (I guess you need an excessive amount of VRAM). Inference is probably gonna be offloaded to consumers in the end where the NPU is taking care of the inference cost (See Apple, Qualcomm etc)
Yes, so R&D and finalizing the model weight is done on NVIDIA GPUs (I guess you need an excessive amount of VRAM).
Inference is probably gonna be offloaded to consumers in the end where the NPU is taking care of the inference cost (See Apple, Qualcomm etc)