Breaking News

Google Outlines How It Tackles Disinformation Across Seearch, News and Youtube LG V50 ThinQ 5G Smartphone Appears Online TCL's Foldable Phone Bends Into a Smartwatch Uber's Growth is Slowing Apple Said to Buying Voice App Startup Pullstring

logo

  • Share Us
    • Facebook
    • Twitter
  • Home
  • Home
  • News
  • Reviews
  • Legacy
    • Media Tests
    • DVD Media Formats

    • Glossary
    • FAQ
    • Firmware
    • Drivers
    • BIOS
    • Software
  • Forum
  • About
    • Submit News

    • Contact Us
    • Privacy

    • Promotion
    • Advertise

    • RSS Feed
    • Site Map

Search form

New NVIDIA Tesla T4 GPU and New TensorRT Software Enable Intelligent Voice, Video, Image and Recommendation Services

New NVIDIA Tesla T4 GPU and New TensorRT Software Enable Intelligent Voice, Video, Image and Recommendation Services

GPUs Sep 13,2018 0

At the GPU Technology Conference in Tokyo, NVIDIA founder and CEO Jensen Huang announced the new NVIDIA Tesla T4 GPU and TensorRT software to enable intelligent voice, video, image and recommendation services.

The NVIDIA TensorRT Hyperscale Inference Platform features NVIDIA Tesla T4 GPUs based on the company's NVIDIA Turing architecture and a set of new inference software.

The platform enables hyperscale data centers to offer new services, such as enhanced natural language interactions and direct answers to search queries rather than a list of possible results.

To optimize the data center for maximum throughput and server utilization, the NVIDIA TensorRT Hyperscale Platform includes both real-time inference software and Tesla T4 GPUs, which process queries up to 40x faster than CPUs alone.

NVIDIA estimates that the AI inference industry is poised to grow in the next five years into a $20 billion market.

The NVIDIA TensorRT Hyperscale Platform includes:

  • NVIDIA Tesla T4 GPU - Featuring 320 Turing Tensor Cores and 2,560 CUDA cores, this new GPU provides high performance with flexible, multi-precision capabilities, from FP32 to FP16 to INT8, as well as INT4. Packaged in a 75-watt, small PCIe form factor that fits into most servers, it offers 65 teraflops of peak performance for FP16, 130 teraflops for INT8 and 260 teraflops for INT4.
  • NVIDIA TensorRT 5 - An inference optimizer and runtime engine, NVIDIA TensorRT 5 supports Turing Tensor Cores and expands the set of neural network optimizations for multi-precision workloads.
  • NVIDIA TensorRT inference server - This containerized microservice software enables applications to use AI models in data center production. Freely available from the NVIDIA GPU Cloud container registry, it maximizes data center throughput and GPU utilization, supports all popular AI models and frameworks, and integrates with Kubernetes and Docker.

NVIDIA Tesla T4 Specifications

  • Turing Tensor Cores:320
  • NVIDIA CUDA cores: 2,560
  • Single Precision Performance (FP32): 8.1 TFLOPS
  • Mixed Precision (FP16/FP32): 65 FP16 TFLOPS
  • INT8 Precision: 130 INT8 TOPS
  • INT4 Precision: 260 INT4 TOPS
  • Interconnect: Gen3 x16 PCIe
  • Memory: 16 GB GDDR6, 320+ GB/s
  • Power: 75 watts

Autonomous cars

Huang also announced NVIDIA AGX, a series of embedded AI high-performance computers built around NVIDIA's new Xavier processors, the first processors built for autonomous machines.

Huang announced the availability of several developer kits that will let developers put Xavier to work: the Jetson AGX Xavier devkit for autonomous machine such as robots and drones and the DRIVE AGX Xavier devkit for autonomous vehicles.

Yamaha Motor Co. has selected NVIDIA Jetson AGX Xavier as the development system for its upcoming line of autonomous machines.

Huang also announced commercial vehicle manufacturer Isuzu is collaborating with NVIDIA to build AI technologies into its autonomous trucks.

Huang gave a shout-out to Fujifilm Corp., the first company in Japan to adopt the NVIDIA DGX-2 AI supercomputer, which it's using to build a supercomputing cluster to accelerate the development of AI technology for fields such as healthcare and medical imaging systems.

Huang also announced telecom giant NTT Group will adopt NVIDIA's AI platform for its company-wide "corevo" AI initiative.

Huang unveiled the NVIDIA Clara AGX - a computing architecture based on the NVIDIA Xavier AI computing module and NVIDIA Turing GPUs - and the Clara software development kit for developers to create a wide range of AI-powered applications for processing data from medical devices.

Tags: Tensor processing unitNvidia Tesla
Previous Post
AT&T, Sprint, T-Mobile and Verizon Demonstrate the Future of Mobile Authentication
Next Post
Nintendo Switch Online Service Coming on September 18th

Related Posts

  • Google's Third Generation of Tensor Processing Unit Offers 100 Petaflops in Performance

  • NVIDIA CEO Declares Death of Moore's Law, Outlines Company's GPU-centered Ecosystem

  • Google I/O: Google Digital Assistant Coming to iPhone, Android O, Android Go, New TPU and VR

  • Google Says Its Tensor Processing Unit Outperforms CPUs And GPUs

0 Comments

Leave a Reply

More information about text formats

Filtered HTML

  • Web page addresses and e-mail addresses turn into links automatically.
  • Allowed HTML tags: <a> <em> <strong> <cite> <blockquote> <code> <ul> <ol> <li> <dl> <dt> <dd>
  • Lines and paragraphs break automatically.

Plain text

  • No HTML tags allowed.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Lines and paragraphs break automatically.

BBCode

  • No HTML tags allowed.
  • You may use these tags: [abbr], [acronym], [b], [center], [code], [color], [define], [font], [h1], [h2], [h3], [h4], [h5], [h6], [hr], [i], [img], [justify], [left], [list], [node], [php], [quote], [right], [s], [size], [sub], [sup], [u], [url], [wikipedia], [youtube], [align], [link], [ol], [ul]
  • Lines and paragraphs break automatically.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Image CAPTCHA
Enter the characters shown in the image.

Latest News

Google Outlines How It Tackles Disinformation Across Seearch, News and Youtube
Enterprise & IT

Google Outlines How It Tackles Disinformation Across Seearch, News and Youtube

LG V50 ThinQ 5G Smartphone Appears Online
Smartphones

LG V50 ThinQ 5G Smartphone Appears Online

TCL's Foldable Phone Bends Into a Smartwatch
Smartphones

TCL's Foldable Phone Bends Into a Smartwatch

Uber's Growth is Slowing
Enterprise & IT

Uber's Growth is Slowing

Apple Said to Buying Voice App Startup Pullstring
Enterprise & IT

Apple Said to Buying Voice App Startup Pullstring

Popular Reviews

Zidoo Z9S 4K Media Player review

Zidoo Z9S 4K Media Player review

CeBIT 2005

CeBIT 2005

CeBIT 2006

CeBIT 2006

LiteOn iHBS112 review

LiteOn iHBS112 review

Nvidia GeForce RTX 2080 Ti and GeForce 2080 Founder's Edition review

Nvidia GeForce RTX 2080 Ti and GeForce 2080 Founder's Edition review

Sony NS955 DVD Player

Sony NS955 DVD Player

Toshiba Exceria M303 64GB and M501 Exceria Pro 64GB MicroSDXC review

Toshiba Exceria M303 64GB and M501 Exceria Pro 64GB MicroSDXC review

Ridisc Media Tests

Ridisc Media Tests

  • Home
  • News
  • Reviews
  • Legacy
    • Media Tests
    • DVD Media Formats

    • Glossary
    • FAQ
    • Firmware
    • Drivers
    • BIOS
    • Software
  • Forum
  • About
    • Submit News

    • Contact Us
    • Privacy

    • Promotion
    • Advertise

    • RSS Feed
    • Site Map
  • About
  • Privacy
  • Contact Us
  • Promotional Opportunities @ CdrInfo.com
  • Advertise on out site
  • Submit your News to our site
  • RSS Feed