Hey presto! Nvidia pulled a software hack out of the AI ​​hat and doubled the performance of the H100 GPU for free

Rate this post

Nvidia is teaming up with a list of tech partners on a game-changing piece of software set to double the performance of its flagship H100 Tensor Core GPU.

The open source TensorRT-LLM update, which is set for release in the coming weeks, is an updated system that outperforms the A100 by eight times, while the H100s will only outperform the A100 by four times. It was tested on GPT-J 6B, a model used to summarize articles in CNN and the Daily Mail.

Leave a Comment