Connect with us

Servers computers

BIG AI Servers NEED This

Published

on

BIG AI Servers NEED This



We take a look at a state-of-the-art liquid cooled NVIDIA H100 8x GPU server from Supermicro. We show why modern AI servers need liquid cooling. We also show some of the other cool bits from the company’s liquid cooling lab including 2U 4-node servers with Intel Xeon and AMD EPYC liquid cooling blocks.

STH Main Site Article: https://www.servethehome.com/supermicro-custom-liquid-cooling-rack-a-look-at-the-cooling-distribution/
STH Top 5 Weekly Newsletter: https://eepurl.com/dryM09

———————————————————————-
Become a STH YT Member and Support Us
———————————————————————-
Join STH YouTube membership to support the channel: https://www.youtube.com/channel/UCv6J_jJa8GJqFwQNgNrMuww/join

STH Merch on Spring: https://the-sth-merch-shop.myteespring.co/

Advertisement

———————————————————————-
Where to Find STH
———————————————————————-
STH Forums: https://forums.servethehome.com
Follow on Twitter: https://twitter.com/ServeTheHome
Follow on LinkedIn: https://www.linkedin.com/company/servethehome-com/
Follow on Facebook: https://www.facebook.com/ServeTheHome/
Follow on Instagram: https://www.instagram.com/servethehome/

———————————————————————-
Other STH Content Mentioned in this Video
———————————————————————-
– Liquid vs. Air Cooling NVIDIA A100 servers: https://youtu.be/4Np1HnWiHb4
– Touring the Liquid Cooling Lab: https://youtu.be/0674Vla9mwk
– How Server Liquid Cooling Works: https://youtu.be/x4ta3dcOosA
– Liquid Cooling Takes over SC21: https://youtu.be/t2Xk8hwNsZ4

———————————————————————-
Timestamps
———————————————————————-
00:00 Introduction
01:54 How Liquid Cooled AI Servers Work
05:01 Liquid Cooling an NVIDIA H100 AI server and high-density Intel Xeon and AMD EPYC servers
12:03 Supermicro Liquid Cooling Power Savings
12:31 Why we need liquid cooling .

source

Advertisement
Continue Reading
Advertisement
28 Comments

28 Comments

  1. @backacheache

    November 4, 2024 at 3:39 pm

    How do they stop condensation?

  2. @ewenchan1239

    November 4, 2024 at 3:39 pm

    I was designing my own waterblocks for the Socket940 AMD Opteron back in 2006, when I was in university, doing my bachelor's in mechanical engineering.

    This isn't new.

    This story has been, at least, 17 years in the making.

  3. @BlackWidow-u9x

    November 4, 2024 at 3:39 pm

    very interesting! As always, an exciting video that keeps the viewer watching. The quiet background music was a bit disturbing. they could have safely been left out.

  4. @zbigniewmalec4816

    November 4, 2024 at 3:39 pm

    Hi Patrick. Is there a chance for the article about how to prepare DC space for liquid cooling. Colo space tends to be dry and facility water is not something that exists close by.

  5. @fuzzyfuzzyfungus

    November 4, 2024 at 3:39 pm

    I'm a bit surprised to see the rPi show up. A CM4 certainly does the job and has an attractively low barrier to entry; but I would have assumed that Supermicro would have just slapped an Aspeed onto anything that even resembles a baseboard in need of management out of pure reflex.

    Is it known whether there's something about an AST2600 that made it unsuitable; or whether the group behind the design of the liquid cooling system is sufficiently distinct from the motherboard side that they aren't in a position to reuse the BMC work already done and so went with the rPi as a better option for working from scratch?

  6. @ve2jgs

    November 4, 2024 at 3:39 pm

    Put the computers in a cold climate and use the resulting heat for living spaces or other productive use..

  7. @TAP7a

    November 4, 2024 at 3:39 pm

    The suitcase spin at the beginning was buttery smooth

  8. @hashim5900

    November 4, 2024 at 3:39 pm

    This

  9. @glennmcgurrin8397

    November 4, 2024 at 3:39 pm

    Any chance these things can run on cooling tower condenser water instead of chiller water? That would really ramp the power savings to the max if you could skip chillers entirely or at least on many days of the year.

  10. @RobertBunger

    November 4, 2024 at 3:39 pm

    Very very good summary of the state of the industry and a liquid cooled rack system. SuperMicro has been on the leading edge of moving liquid cooled IT from specialized installs into mainstream & they are working in many industry organization in this pursuit.

  11. @alexlandherr

    November 4, 2024 at 3:39 pm

    At 5:52, CM4 in the CDU?

  12. @cappie2000

    November 4, 2024 at 3:39 pm

    Houses should have hot and cold loops too.

  13. @magnawavezone

    November 4, 2024 at 3:39 pm

    The sad reality of liquid cooling in the datacenter, is that it’s been kicked around for over 20 years, and yet every solution is proprietary and gains about 0 market penetration. Wash rinse repeat with the latest solution. DCs are crazy expensive and infra has to last a long time so customers are rightfully leery. Air cooling is universal and compatible with everything, albeit inefficient. Triply so, hyperscalers are very cost sensitive and this all looks very much the opposite of that.

    AI may change that but there is some serious uphill battle here.

  14. @123454142

    November 4, 2024 at 3:39 pm

    Hi, what's intrinsic power usage of each CDU for pumps and controls? I looked and couldn't find any data

  15. @jonlaban4272

    November 4, 2024 at 3:39 pm

    Is this proprietary liquid heat transfer hardware system compatible with the open source hardware rack – Open Compute Project Open Rack v3 – which went into mass production in 2023?

  16. @nexusyang4832

    November 4, 2024 at 3:39 pm

    So when could we start seeing geothermal combine with liquid cooling?

  17. @accesser

    November 4, 2024 at 3:39 pm

    Interesting upload, not something we see everyday

  18. @MidSeasonGroup

    November 4, 2024 at 3:39 pm

    Do you have a homelab AI server recommendation to fine-tune LLMs? Thank you in advance.

  19. @michaelfragrances

    November 4, 2024 at 3:39 pm

    Sweden, the heat generated by data centers is used to heat entire cities.

    The aluminum and copper parts of the radiator look very high quality. Connection from servers looks incredibly cool😎

  20. Anonymous

    November 4, 2024 at 3:39 pm

    Hey I just tried to read some of your articles over RSS. Is there a chance you could the articles directly into the RSS feed?

  21. @nicknorthcutt7680

    November 4, 2024 at 3:39 pm

    San jose is my hometown, I miss SJ and the Sunnyvale/Mountain View area, so much cool tech stuff in that area.

  22. @coming54

    November 4, 2024 at 3:39 pm

    Thanks for the informative video! I noticed that Asetek units, including the CDU, were used in the A100 server. Did Asetek products get replaced with Supermicro's in-house developed products for the H100 server?

  23. @AriBenDavid

    November 4, 2024 at 3:39 pm

    I just toured a large data center where experiments in liquid cooling were taking place. They were abandoning the experiment for now as the coolant fluid is considered toxic. Further, conventional cooling including liquid requires huge water usage.

  24. @tristanwegner

    November 4, 2024 at 3:39 pm

    liquid cooling also makes it easier to transfer to district heating as a secondary use of the waste heat

  25. @OpenAITutor

    November 4, 2024 at 3:39 pm

    This is fantastic! Thank you for your efforts; they're truly inspiring. I hope everyone recognizes the importance of the work being done at SuperMicro.

  26. @ArneiroS

    November 4, 2024 at 3:39 pm

    5:50 Is that a CM4?

  27. @richardgalarza7882

    November 4, 2024 at 3:39 pm

    He does not raise the safety concerns of DLC. Leaks can be catastrophic to a datacenter. Leak detection development is a must!

  28. @MelroyvandenBerg

    November 4, 2024 at 3:39 pm

    This.. THIS.. THISS!.. This is Patrick.

You must be logged in to post a comment Login

Leave a Reply

Servers computers

How To Assemble Kawachi Laptop Table Computer Desk and Writing Study Table With Printer Book Shelf

Published

on

How To Assemble Kawachi Laptop Table Computer Desk and Writing Study Table With Printer Book Shelf



Description
This computer desk mixes urban and rustic elements to bring you an industrial style desk ideal for any modern home. Great for apartments or homes in need of a space-saving desk, the simple design gives it a multifunctional purpose, letting you choose how you use it—in the office for work, playroom for board games, living room for family use, and more. To make things a little easier, this desk has a simplified assembly process with easy-to-follow, illustrated directions. Our wood writing folding table comes with an MDF board and high-quality metal frame construction, which is the heavy-duty, sturdy, durable, and large weight capacity. It will suit any décor and bring new energy to your home or sturdy room.
Elegant Design – With its elegant design and clean aesthetic, the table has an ideal height that provides you with a better working experience, it’s metal legs and construction maximizes interior leg space that makes your work routine comfortable.
Multipurpose Desk – The surface is perfect for a laptop or your daily paperwork, it’s not only a computer desk, but it can also be used in a study, working, writing, reading, and doing all sorts of things, useful for home, tuitions, coaching classes, school, colleges, offices, etc.…
Easy to assemble – The table requires minimal assembly before it can be used. Easy to follow instructions.
A Perfect Fit For Any Room – Add a chic touch to your office or home with this Computer Desk that adds a touch of charm to most rooms. so you might as well get a desk that not only fits everything you need but looks and feels great.

Specifications
Material: HD MDF wood, Steel Tube powder coated Frame
Color: Beige
Flatpack: Assembly required
Package: 1*Computer Desk (not include chair)

@diyfurniture399 #Computerdesk #DIYFurniture #howto .

source

Continue Reading

Servers computers

Converged Infrastructure Solutions for Storage, Networking and Blade Servers

Published

on

Converged Infrastructure Solutions for Storage, Networking and Blade Servers



At the HP Global Partner Conference, HP announced new HP BladeSystem, HP Networking, and HP Converged Storage solutions. New BladeSystem offerings are designed to improve performance and reducing data center costs. In the storage arena, HP StoreSystem combines HP 3PAR StoreServ Storage and HP StoreOnce Backup systems in a pre-racked configuration. In networking, HP announced a combined wired and wireless networking offering designed to provide seamless support for enterprise BYOD initiatives. I had the chance to talk with Stephen DeWitt, Senior Vice President & General Manager of HP’s Enterprise Group, about the announcements and HP’s Converged Infrastructure strategy. .

source

Continue Reading

Servers computers

linux – HP BLADE machines – identify the Server name from my Linux OS (2 Solutions!!)

Published

on

linux - HP BLADE machines - identify the Server name from my Linux OS (2 Solutions!!)



linux – HP BLADE machines – identify the Server name from my Linux OS

Helpful? Please support me on Patreon: https://www.patreon.com/roelvandepaar

With thanks & praise to God, and with thanks to the many people who have made this project possible! | Content (except music & images) licensed under CC BY-SA https://meta.stackexchange.com/help/licensing | Music: https://www.bensound.com/licensing | Images: https://stocksnap.io/license & others | With thanks to user yael (serverfault.com/users/101912), user the-wabbit (serverfault.com/users/76595), user ewwhite (serverfault.com/users/13325), and the Stack Exchange Network (serverfault.com/questions/335716). Trademarks are property of their respective owners. Disclaimer: All information is provided “AS IS” without warranty of any kind. You are responsible for your own actions. Please contact me if anything is amiss at Roel D.OT VandePaar A.T gmail.com .

source

Continue Reading

Servers computers

Spending $4,534,741 For CHROMA SWORDS In Blade Ball

Published

on

Spending $4,534,741 For CHROMA SWORDS In Blade Ball



Spending $4,534,741 For CHROMA SWORDS In Blade Ball

What is Roblox? ROBLOX is an online virtual playground and workshop, where kids of all ages can safely interact, create, have fun, and learn. It’s unique in that practically everything on ROBLOX is designed and constructed by members of the community. ROBLOX is designed for 13 to 18 year olds, but it is open to people of all ages. Each player starts by choosing an avatar and giving it an identity. They can then explore ROBLOX — interacting with others by chatting, playing games, or collaborating on creative projects. Each player is also given their own piece of undeveloped real estate along with a virtual toolbox with which to design and build anything — be it a navigable skyscraper, a working helicopter, a giant pinball machine, a multiplayer “Capture the Flag” game or some other, yet-to-be-dreamed-up creation. There is no cost for this first plot of virtual land. By participating and by building cool stuff, ROBLOX members can earn specialty badges as well as ROBLOX dollars (“Robux”). In turn, they can shop the online catalog to purchase avatar clothing and accessories as well as premium building materials, interactive components, and working mechanisms.

roblox blade ball,blade ball,blade ball roblox,blade ball codes,roblox blade ball codes,blade ball roblox all abilities,ball blade,blade ball pro,blade ball infinity,roblox blade ball pro,blade ball best player,best ability blade ball,blade ball tips and tricks,blade ball roblox abilities,roblox blade ball best ability,blade ball update,blade ball rapture,codes for blade ball,blade ball best ability,blade ball raging deflect,blade ball pull

#bladeball #robloxbladeball .

source

Advertisement
Continue Reading

Servers computers

HP ProLiant ML30 Gen10 Tower Server Bundle with Intel Xeon E-2136, 64GB DDR4, 8TB SSD, RAID, Window

Published

on

HP ProLiant ML30 Gen10 Tower Server Bundle with Intel Xeon E-2136, 64GB DDR4, 8TB SSD, RAID, Window



Click here for the best price:
https://amzn.to/44iLBDP
This is an Affiliate link

HP ProLiant ML30 Gen10 Tower Server Bundle with Intel Xeon E-2136, 64GB DDR4, 8TB SSD, RAID, Windows Server 2019

HP ProLiant ML30 Gen10 Tower Server Bundle with Intel Xeon E-2136, 64GB DDR4, 8TB SSD, RAID, Windows Server 2019
This presentation contains images that were used under a Creative Commons License. .

source

Continue Reading

Servers computers

Proxmox VE 5.3 Install on Lenovo x3650 M5 Rack Server – 792

Published

on

Proxmox VE 5.3 Install on Lenovo x3650 M5 Rack Server - 792



I am going to be trying out Proxmox in the futura here. as a replacement for VMWare ESXi, that has been losing good will for a while. Moving cool stuff over in all of there expensive add on packages..

So I will be trying to move over to Proxmox.

Link to Proxmox : https://www.proxmox.com/en/
Link to LenovoPress on the x3650 M5 : https://goo.gl/xenbiX

[Affiliate Links]
Link US – Lenovo x3650 M5 8871-KEU: https://amzn.to/2E2LF2g
Link UK – Lenovo x3650 M5 8871-EJG: https://amzn.to/2Q5EUDu
________________________________________________________________
http://www.patreon.com/myplayhouse
Even just 1$ a month, comes out to the same as Binge-watching like 400+ of me Videos every month.

Advertisement

My PlayHouse is a channel where i will show, what i am working on. I have this house, it is 168 Square Meters / 1808.3ft² and it is full, of half-finished projects.

I love working with heating, insulation, Servers, computers, Datacenter, green power, alternative energy, solar, wind and more. It all costs, but I’m trying to get the most out of my money, and my time. .

source

Continue Reading

Trending

Copyright © 2024 WordupNews.com