Tag: Radeon RX 7900 XTX

  • GeForce RTX 5090 Beats Radeon RX 7900 XTX in DeepSeek Test

    GeForce RTX 5090 Beats Radeon RX 7900 XTX in DeepSeek Test

    Last week, AMD asserted that its Radeon RX 7900 XTX could outperform Nvidia’s GeForce RTX 4090 in a DeepSeek benchmark. However, the test did not include Nvidia’s latest Blackwell-based GeForce RTX 5090, instead using the older RTX 4080 Super. In response, Nvidia has released its own benchmarks, which, as expected, highlight its products in a much more favorable manner.

    Proper Labelling Matters

    In contrast to AMD, Nvidia accurately labeled its Y-axis (tokens/second). It conducted tests using the Llama-bench platform with int4 quantization. In the initial test featuring 7 billion parameters, the Radeon RX 7900 XTX reached just over 100 tokens per second. The RTX 4090 outperformed it by 46%, achieving around 150 tokens per second, while the RTX 5090 surpassed it by an impressive 103%, hitting approximately 200 tokens per second.

    Consistent Results Across Models

    The results remain largely consistent with a model of 8 billion tokens, and when testing with a 32 billion token model, the RTX 5090’s advantage increases to 124%, generating about 50 tokens per second. It’s important to note that these benchmarks come directly from the companies and should be viewed with a degree of skepticism. Additionally, both companies seem to have designed their testing methods to favor their own results. Nonetheless, it isn’t shocking to see that the RTX 5090 outpaces the two-year-old RX 7900 XTX, particularly in a competitive environment where Nvidia has a stronghold.

    Source:
    Link


     

  • Radeon RX 7900 XTX Beats RTX 4090 & 4080 Super in DeepSeek AI

    Radeon RX 7900 XTX Beats RTX 4090 & 4080 Super in DeepSeek AI

    Chinese LLM DeepSeek caused a significant disturbance in the US tech industry, leading to a loss of trillions of dollars from the stock market. Even though it was developed using somewhat older Nvidia hardware, it surprisingly performs quite well on AMD’s consumer product: the Radeon RX 7900 XTX. David McAfee, who oversees AMD’s Radeon division, shared some benchmark results on X.

    Performance Insights

    The Radeon RX 7900 XTX shows performance differences based on the model and the number of parameters being used. It can be up to 13% faster at 7 billion parameters and about 2% faster at 14 billion parameters. Beyond that point, the RDNA 3 flagship struggles, ultimately falling short compared to the RTX 4090 with 32 billion parameters. AMD even made a comparison with the GeForce RTX 4080 Super, where the 7900 XTX boasts a 34% advantage in performance.

    Running DeepSeek Locally

    AMD has also shared comprehensive guidelines on how to operate DeepSeek on your own computer. However, it’s important to note that the Radeon RX 7900 XTX has a limit of 32 billion parameters. On the other hand, the Strix Halo Ryzen AI Max 395 Plus, equipped with 128 GB of RAM, can handle up to 72 billion parameters. Additionally, for those who are willing to spend around $6,000, Matthew Carrigan has discovered a method to run the entire model locally on a system with dual AMD Epyc CPUs and 768 GB of RAM.

    Source:
    Link