<nobr id="rrdlf"><dfn id="rrdlf"><cite id="rrdlf"></cite></dfn></nobr>
              <video id="rrdlf"></video>

              <video id="rrdlf"></video>
              Welcome:Beijing Plink Ai Technology Co.,LTD.Service Hotline:+86-400-127-3302
              Language: Chinese ∷  English

              News

              How to break the bottleneck of Decoder performance? Nvidia experts reveal the secrets

              Since "Attention is All You Need" was introduced in 2017, Transformer has become a very popular deep learning network architecture in the NLP space. However, in the inference deployment phase, its computing performance often fails to meet the requirements of low latency and high throughput for online services.

              In Nvidia's open-source FasterTransformer 1.0 version, the Transformer Encoder in BERT has been optimized and accelerated to reduce the latency of coding with transformer.

              Having solved the Encoder performance problem, Nvidia has focused on the equally important Transformer Decoder reasoning.

              As a result, Nvidia has introduced version 2.0 of FasterTransformer, which offers a transformer layer that is highly optimized for decoders. At the same time, the optimized translation process is also provided to meet the needs of users who want to significantly reduce latency in translation scenarios.
              久久综合狠狠综合久久_国产乱子伦XXXX_日韩中文精品无码_亚洲日本韩国不卡中文字幕