阅读 136

TVM性能评估分析(三)

TVM性能评估分析(三)

TVM性能评估分析(三)

 

 

 Figure 1. TVM’s WebGPU backend close to native GPU performance when deploying models to the web.

 

 

 Figure 2.  WebGPU is to write shaders for primitive operators in deep neural networks

 

 

 Figure 3.  Build a WebGPU runtime inside TVM’s JS runtime

 

 

 Figure 4. Comparing the execution of a full computational graph via TVM’s WebGPU backend and native targets

 

 

 Figure 5. 2D convolution with data layout in NCHW4c and weight layout in OIHW4o4i. Left: The input tensor in NCHW4c layout. One moving filter of the kernel is colored in blue. One element of the input and kernel is colored in grey. Mid: The packed input and kernel in the grey block. Right: The output in NCHW4c layout. Inside the one element depicted, there are four packed elements in channel sub-dimension.

 

 

 Figure 6. Workflow of running quantized models

 

 

 Figure 7.  A full deep learning compiler stack to support machine learning workloads for diverse hardware backends.

 

 

 Figure 8. Golang Interface over TVM Runtime

 

 

 Figure 9.  Import, Compile, Integrate and Deploy

人工智能芯片与自动驾驶

来源https://www.cnblogs.com/wujianming-110117/p/14826975.html

文章分类
后端
文章标签
版权声明:本站是系统测试站点,无实际运营。本文内容由互联网用户自发贡献,该文观点仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌抄袭侵权/违法违规的内容, 请发送邮件至 XXXXXXo@163.com 举报,一经查实,本站将立刻删除。
相关推荐