Tag: AI Data Centers

  • Nvidia Blackwell AI Chips Overheat in Server Racks Issues

    Nvidia Blackwell AI Chips Overheat in Server Racks Issues

    Nvidia’s Blackwell AI chips might be delayed again due to overheating issues in server racks that can hold up to 72 GPUs. According to The Information (via Reuters), Nvidia has asked its suppliers to modify the design of these high-capacity racks and is collaborating with them to enhance thermal efficiency.

    Collaboration with Partners

    A spokesperson from Nvidia stated to Reuters, "Nvidia is working with leading cloud service providers as an integral part of our engineering team and process. The engineering iterations are normal and expected." This highlights the company’s ongoing commitment to address the challenges faced during development.

    Previous Delays

    This isn’t the first instance of delays related to Blackwell. Back in August, Bloomberg shared that Nvidia had to adjust the chip design to ensure it would be more compatible with the Hopper H100 data centers. This history of modifications raises questions about the stability of the release timeline.

    Concerns from Major Companies

    In March, Nvidia had assured that the new chips would be on the market by the second quarter of the year, but those plans changed due to the recent setbacks. The Information reports that companies like Microsoft, Google, and Meta are now anxious about how these delays could impact their schedules for deploying the new chips in their data centers, which may also slow down the release of next versions of their AI-based products.

    As reported by Reuters and Bloomberg, the situation remains critical for Nvidia and its partners.

    Source: Link,Link

    Tags: , ,
  • Bees Halt Meta’s Plan for First Nuclear-Powered AI Data Center

    Bees Halt Meta’s Plan for First Nuclear-Powered AI Data Center

    Meta has had to abandon its ambitions for a nuclear-powered AI data center in the United States due to environmental hurdles. The company initially aimed to establish a facility that would utilize emissions-free energy from a recognized nuclear plant operator, positioning Meta as one of the pioneering tech entities to look into nuclear energy specifically for AI processing.

    Environmental Challenges Arise

    Unfortunately, the discovery of a rare bee species on the selected location for the data center introduced regulatory and environmental challenges, which ultimately resulted in the cessation of the project. This unexpected finding presented significant issues that Meta could not navigate, leading to the decision to halt the initiative.

    The Quest for Sustainable Energy

    Big tech firms are increasingly turning to nuclear power as a solution for their energy needs in AI advancement, primarily because AI models necessitate immense computational capabilities, resulting in high energy consumption, often 24/7. Conventional energy sources, particularly fossil fuels, face difficulties in offering sustainable and scalable energy without boosting carbon emissions.

    In contrast, nuclear energy provides a reliable, emissions-free power source that aligns with the environmental goals and long-term objectives of the tech industry, making it an attractive option for companies like Meta.

    A Setback for Meta’s Nuclear Goals

    During an all-hands meeting, CEO Mark Zuckerberg shared his frustration, indicating that the company was ready to proceed with the nuclear supplier to guarantee clean energy for the facility. Although Meta’s nuclear aspirations for this particular site are currently on hold, the company is still considering other pathways to obtain low-carbon energy. This strategy is in line with a larger movement among tech giants such as Microsoft, Google, and Amazon, all of which have recently expressed interest in nuclear energy for their data centers.

    For instance, Microsoft has entered into a 20-year contract to obtain energy from the historic Three Mile Island nuclear facility, which has been renamed the Crane Clean Energy Center, to fuel its own AI projects. Meanwhile, Google and Amazon are investing in small modular reactors (SMRs), which are compact nuclear units designed for safer and more flexible implementation, with Google anticipating that its reactors will be active by 2030.

    Looking Ahead

    Meta is still dedicated to investigating further clean energy sources to support its data-heavy AI operations. The tech industry’s growing dependence on nuclear energy highlights the increasing energy demands of AI and the essential role of clean energy in achieving sustainability objectives. Nevertheless, for the time being, the presence of at-risk wildlife and the regulatory environment have shifted Meta’s plans for a nuclear-driven AI future.

    Image 1
    Tags: , ,