High Bandwidth Memory

You're viewing the source. Log in to edit.

{| cellpadding="7" style="max-width: 400px; width: 100%; border: 2px solid #176B5C; border-collapse: collapse; font-size: 0.9em;"
|-
| colspan="2" style="background: #176B5C; text-align: center; padding: 10px 8px 12px 8px; border-bottom: 2px solid #176B5C;" |
<div style="color: #ffffff; font-size: 0.82em; letter-spacing: 0.08em;">COMPUTER MEMORY</div>
<div style="color: #ffffff; font-weight: bold; font-size: 1.4em; margin: 3px 0 1px 0;">High Bandwidth Memory</div>
<div style="color: #ffffff; font-size: 0.92em;">HBM</div>
|- style="border-bottom: 1px solid #d8ebe6;" darkstyle="border-color: #2c2c2e;"
! scope="row" style="color: #176B5C; text-align: center; width: 36%;" darkstyle="color: color-mix(in srgb, #176B5C 55%, #f5f5f7);" | Type
| Stacked [[Dynamic random-access memory|DRAM]]<ref name="skhynix-tsv">"Become a Semiconductor Expert with SK hynix — HBM." ''SK hynix Newsroom'' (official), May 2, 2023. [https://news.skhynix.com/become-a-semiconductor-expert-with-sk-hynix-hbm/ news.skhynix.com]. Retrieved July 2026.</ref>
|- style="border-bottom: 1px solid #d8ebe6;" darkstyle="border-color: #2c2c2e;"
! scope="row" style="color: #176B5C; text-align: center;" darkstyle="color: color-mix(in srgb, #176B5C 55%, #f5f5f7);" | Standardised
| October 2013 (JESD235)<ref name="memforum">O'Connor, Mike. "Highlights of the High-Bandwidth Memory (HBM) Standard." ''The Memory Forum'', June 14, 2014. [https://www-old.cs.utah.edu/thememoryforum/mike.pdf utah.edu]. Retrieved July 2026.</ref>
|- style="border-bottom: 1px solid #d8ebe6;" darkstyle="border-color: #2c2c2e;"
! scope="row" style="color: #176B5C; text-align: center;" darkstyle="color: color-mix(in srgb, #176B5C 55%, #f5f5f7);" | First product
| AMD Radeon R9 Fury X, June 2015<ref name="amd-fury">"AMD Radeon R9 Fury X: The World's First HBM-Powered Graphics Card." ''AMD'' (official), June 16, 2015. [https://ir.amd.com/news-events/press-releases/detail/619/ amd.com]. Retrieved July 2026.</ref>
|- style="border-bottom: 1px solid #d8ebe6;" darkstyle="border-color: #2c2c2e;"
! scope="row" style="color: #176B5C; text-align: center;" darkstyle="color: color-mix(in srgb, #176B5C 55%, #f5f5f7);" | Current standard
| HBM4 (JESD270-4, 2025)<ref name="hbm4">"JEDEC and Industry Leaders Collaborate to Release JESD270-4 HBM4 Standard." ''JEDEC'' (official), April 16, 2025. [https://www.jedec.org/news/pressreleases/jedec%C2%AE-and-industry-leaders-collaborate-release-jesd270-4-hbm4-standard-advancing jedec.org]. Retrieved July 2026.</ref>
|- style="border-bottom: 1px solid #d8ebe6;" darkstyle="border-color: #2c2c2e;"
! scope="row" style="color: #176B5C; text-align: center;" darkstyle="color: color-mix(in srgb, #176B5C 55%, #f5f5f7);" | Used in
| AI accelerators, supercomputers, some graphics cards<ref name="hbm4" />
|-
| colspan="2" | {{Collapse|text="'''[ More details ▾ ]'''"|color="#176B5C"|style="width:100%;"}}
|- style="border-bottom: 1px solid #d8ebe6;" darkstyle="border-color: #2c2c2e;"
! scope="row" style="color: #176B5C; text-align: center; width: 36%;" darkstyle="color: color-mix(in srgb, #176B5C 55%, #f5f5f7);" | Interface width
| 1,024 bits (HBM to HBM3E)<br>2,048 bits (HBM4)<ref name="hbm4" /><ref name="memforum" />
|- style="border-bottom: 1px solid #d8ebe6;" darkstyle="border-color: #2c2c2e;"
! scope="row" style="color: #176B5C; text-align: center;" darkstyle="color: color-mix(in srgb, #176B5C 55%, #f5f5f7);" | Peak bandwidth
| Up to 2 TB/s per stack (HBM4)<ref name="hbm4" />
|- style="border-bottom: 1px solid #d8ebe6;" darkstyle="border-color: #2c2c2e;"
! scope="row" style="color: #176B5C; text-align: center;" darkstyle="color: color-mix(in srgb, #176B5C 55%, #f5f5f7);" | Stack height
| 4, 8, 12 or 16 dies<ref name="hbm4" />
|- style="border-bottom: 1px solid #d8ebe6;" darkstyle="border-color: #2c2c2e;"
! scope="row" style="color: #176B5C; text-align: center;" darkstyle="color: color-mix(in srgb, #176B5C 55%, #f5f5f7);" | Capacity
| Up to 64 GB per stack<ref name="hbm4" />
|-
! scope="row" style="color: #176B5C; text-align: center;" darkstyle="color: color-mix(in srgb, #176B5C 55%, #f5f5f7);" | Makers
| [[SK hynix]]<br>[[Samsung Electronics]]<br>[[Micron Technology]]<ref name="counterpoint">"Global DRAM and HBM Market Share: Quarterly." ''Counterpoint Research'', June 10, 2026. [https://counterpointresearch.com/en/insights/global-dram-and-hbm-market-share counterpointresearch.com]. Retrieved July 2026.</ref>
{{Endcollapse}}
|}

'''High Bandwidth Memory''', or '''HBM''', is a form of [[Dynamic random-access memory|DRAM]] built by stacking memory chips on top of one another and wiring them together vertically. The stack sits beside the processor inside the same package, rather than out on the motherboard, and connects to it over an interface thousands of wires wide.<ref name="skhynix-tsv" /><ref name="hbm4" /> It is the memory that artificial-intelligence accelerators are built around, and the most valuable product the memory industry makes.

The reason for all this trouble is bandwidth. A modern accelerator can perform arithmetic far faster than ordinary memory can supply numbers for it to work on, so the memory, not the processor, sets the pace. HBM attacks the problem from the opposite direction to conventional memory: instead of driving a narrow connection at a very high clock rate, it drives an extremely wide one comparatively slowly.<ref name="memforum" /> That turns out to use far less energy for each bit moved, which matters enormously when a data centre's electricity bill is the limiting factor.<ref name="memforum" /><ref name="amd-fury" />

HBM is an open standard, published by JEDEC, the industry body that also defines ordinary DDR memory.<ref name="hbm4" /> Work on it began around 2010, the first version was adopted in October 2013, and [[SK hynix]] developed the first product with AMD.<ref name="memforum" /><ref name="skhynix-story">"Continuing to Make HBM History: The Story of SK hynix's HBM Development." ''SK hynix Newsroom'' (official). [https://news.skhynix.com/en/the-story-of-sk-hynixs-hbm-development/ news.skhynix.com]. Retrieved July 2026.</ref> For its first decade it was a niche part for graphics cards and supercomputers. The AI boom changed that completely, and only three companies — SK hynix, [[Samsung Electronics]] and [[Micron Technology]] — can make it.<ref name="counterpoint" />

== Why it exists ==

Ordinary computer memory is connected by a narrow path driven very fast. A GDDR7 graphics memory chip, for instance, presents a 32-bit interface and pushes it to 32 gigabits per second on each pin, delivering about 128 gigabytes per second per chip.<ref name="gddr7">"Micron GDDR7 memory," product brief. ''Micron Technology'' (official). [https://assets.micron.com/adobe/assets/urn:aaid:aem:087330f6-6d71-4575-b622-cb10f20cdaf0/original/as/gddr7-product-brief.pdf micron.com]. Retrieved July 2026.</ref> Driving signals that fast across a circuit board is expensive in power, and the faster you go the worse it gets.

HBM inverts the trade. An HBM4 stack presents 2,048 bits at a comparatively sedate 8 gigabits per second per pin, which yields up to two terabytes per second — roughly fifteen times a GDDR7 chip.<ref name="hbm4" /><ref name="gddr7" /> The original design was measured at around 6 to 7 picojoules for each bit moved, against 18 to 22 for the GDDR5 memory of the day.<ref name="memforum" /> When AMD shipped the first HBM graphics card it claimed 60% more bandwidth than GDDR5, more than three times the performance per watt, and 94% less board area.<ref name="amd-fury" />

The catch is that 2,048 wires cannot be routed across a circuit board. That constraint is what forces everything else about HBM: the stacking, the special packaging, and the cost.

== How it is built ==

=== Stacking and through-silicon vias ===

The dies in a stack are joined by through-silicon vias, copper connections etched straight down through a thinned wafer so that a chip can pass signals to the one above it.<ref name="skhynix-tsv" /> There are a great many of them: Samsung's twelve-layer packaging used more than 60,000 in a single stack while holding the whole package to 720 micrometres tall.<ref name="samsung-tsv">"Samsung Electronics Develops Industry's First 12-Layer 3D-TSV Chip Packaging Technology." ''Samsung'' (official newsroom), October 7, 2019. [https://news.samsung.com/us/samsung-12-layer-3d-tsv-chip-packaging-technology news.samsung.com]. Retrieved July 2026.</ref> Fitting more dies into that budget means grinding each one thinner. For its sixteen-layer HBM4, SK hynix thins the wafers to 30 micrometres, about a third the width of a human hair.<ref name="eetimes-ces26">"The State of HBM4 Chronicled at CES 2026." ''EE Times'', January 12, 2026. [https://www.eetimes.com/the-state-of-hbm4-chronicled-at-ces-2026/ eetimes.com]. Retrieved July 2026.</ref>

=== The base die ===

At the bottom of every stack sits a base die, sometimes called the logic die, which handles the traffic between the memory above it and the processor beside it. It used to be made on a memory process, but HBM4 changed that. SK hynix agreed with [[TSMC]] in April 2024 to have its HBM4 base die built on a logic foundry process, and the part now uses TSMC's 12-nanometre technology.<ref name="tsmc-mou">"SK hynix Partners With TSMC to Strengthen HBM Technological Leadership." ''SK hynix Newsroom'' (official), April 19, 2024. [https://news.skhynix.com/sk-hynix-partners-with-tsmc-to-strengthen-hbm-technological-leadership/ news.skhynix.com]. Retrieved July 2026.</ref><ref name="eetimes-ces26" />

Samsung took the opposite route, building its HBM4 base die on its own four-nanometre foundry process, which makes it the only supplier that controls the entire stack.<ref name="samsung-hbm4">"Samsung Ships Industry-First Commercial HBM4." ''Samsung'' (official newsroom), February 12, 2026. [https://news.samsung.com/global/samsung-ships-industry-first-commercial-hbm4 news.samsung.com]. Retrieved July 2026.</ref> Micron has contracted TSMC to make the base die for its next generation.<ref name="micron-tsmc">Shilov, Anton. "Micron Teams Up With TSMC to Deliver HBM4E, Targeted for 2027." ''Tom's Hardware'', September 25, 2025. [https://www.tomshardware.com/micron-hands-tsmc-the-keys-to-hbm4e tomshardware.com]. Retrieved July 2026.</ref> A logic base die also opens the door to customisation: SK hynix has said it intends to move beyond standard parts to memory tailored to individual customers.<ref name="tsmc-sym">"SK hynix at the TSMC Technology Symposium 2026." ''SK hynix Newsroom'' (official), April 23, 2026. [https://news.skhynix.com/en/tsmc-technology-symposium-2026/ news.skhynix.com]. Retrieved July 2026.</ref>

=== The interposer ===

The stacks and the processor are mounted side by side on a slab of silicon called an interposer, which carries the thousands of connections between them. This arrangement is known as 2.5D packaging. The dominant version is TSMC's CoWoS, short for chip on wafer on substrate, which places logic chips and HBM stacks together over a large silicon interposer.<ref name="cowos">"CoWoS." ''TSMC'' (official), 3DFabric technology. [https://3dfabric.tsmc.com/english/dedicatedFoundry/technology/cowos.htm tsmc.com]. Retrieved July 2026.</ref>

Interposer capacity has been a hard limit on how many AI accelerators the world can build. TrendForce put the gap between demand and supply for TSMC's packaging at about 20% in mid-2026, narrowing to roughly 10% by the end of the year as capacity comes online.<ref name="tf-cowos">"TSMC CoWoS Supply-Demand Gap Reportedly Seen Narrowing From 20% to 10% by End-2026." ''TrendForce'', June 15, 2026. [https://www.trendforce.com/news/2026/06/15/news-tsmc-cowos-supply-demand-gap-reportedly-seen-narrowing-from-20-to-10-by-end-2026-as-capacity-expands/ trendforce.com]. Retrieved July 2026.</ref> JEDEC published a variant in June 2026 with a narrower 512-bit interface, meant to let cheaper designs use an ordinary organic substrate instead of silicon.<ref name="sphbm4">"JEDEC Releases New SP-HBM4 Standard." ''Tom's Hardware'', 2026. [https://www.tomshardware.com/pc-components/dram/jedec-releases-new-sphbm4-standard-to-slash-ai-memory-costs-narrow-512-bit-interface-enables-dropping-expensive-interposers-for-organic-substrates tomshardware.com]. Retrieved July 2026.</ref>

=== Bonding, heat and cost ===

How the dies are joined matters more than it sounds. SK hynix uses a method it calls MR-MUF, which heats and connects every chip in the stack at once and fills the gaps with a moulding compound in the same step. The alternative, TC-NCF, lays a film between chips and bonds them one layer at a time.<ref name="mrmuf">"Rulebreakers' Revolutions: MR-MUF Unlocks HBM Heat Control." ''SK hynix Newsroom'' (official), July 30, 2024. [https://news.skhynix.com/rulebreaker-revolutions-mr-muf-unlocks-hbm-heat-control/ news.skhynix.com]. Retrieved July 2026.</ref> SK hynix credits its method with better heat dissipation, and says a refined version raised the thermal conductivity of the compound by more than half.<ref name="mrmuf" /><ref name="eetimes-mrmuf">"SK hynix's MR-MUF Innovations Tackle Heat Generation to Secure HBM Leadership." ''EE Times'', December 18, 2024. [https://www.eetimes.com/sk-hynixs-mr-muf-innovations-tackle-heat-generation-to-secure-hbm-leadership/ eetimes.com]. Retrieved July 2026.</ref>

Heat is a real constraint, because a stack of memory sits millimetres from a processor running near its thermal limit and the dies in the middle have nowhere to send their heat. Researchers at imec simulated putting HBM directly on top of a graphics processor rather than beside it and found the assembly reached 140 °C, hot enough to stop working.<ref name="imec">"The Ultimate 3D Integration Would Cook Future GPUs." ''IEEE Spectrum'', January 14, 2026. [https://spectrum.ieee.org/hbm-on-gpu-imec-iedm spectrum.ieee.org]. Retrieved July 2026.</ref> Hybrid bonding, which would do away with the solder bumps between dies altogether, has been expected as the answer for the tallest stacks. It was not used in HBM4, and reports in July 2026 suggest sixteen-layer HBM4E is now the earliest likely adoption.<ref name="tf-hybrid">"Samsung, SK hynix Reportedly Reconsider Hybrid Bonding Timeline." ''TrendForce'', July 7, 2026. [https://www.trendforce.com/news/2026/07/07/news-samsung-sk-hynix-reportedly-reconsider-hybrid-bonding-timeline-16-high-hbm4e-may-be-earliest-adoption/ trendforce.com]. Retrieved July 2026.</ref>

All of this is expensive. A gigabyte of HBM consumes more than three times the wafer area of a gigabyte of ordinary DRAM, so making it eats capacity that would otherwise produce far more memory.<ref name="semi">"From Latency to Reaction: Simulating the Next Wafer Demand Inflection." ''SEMI'', August 11, 2025. [https://www.semi.org/en/blogs/from-latency-to-reaction-simulating-the-next-wafer-demand-inflection semi.org]. Retrieved July 2026.</ref> TrendForce estimated HBM4 wafers at US$7,000 to US$8,000, three to four times the cost of conventional DRAM wafers.<ref name="tf-cost">"Advancement to HBM4 Will Entail Higher Costs With Price Premium Estimated to Exceed 30%." ''TrendForce'', May 9, 2025. [https://www.trendforce.com/research/download/RP250509XF trendforce.com]. Retrieved July 2026.</ref>

== Generations ==

Each generation has roughly doubled the bandwidth of the one before, at first by raising the signalling rate and, with HBM4, by widening the interface.<ref name="memforum" /><ref name="hbm2">"JEDEC Updates Groundbreaking High Bandwidth Memory (HBM) Standard." ''JEDEC'' (official), January 12, 2016. [https://www.jedec.org/news/pressreleases/jedec-updates-groundbreaking-high-bandwidth-memory-hbm-standard jedec.org]. Retrieved July 2026.</ref><ref name="hbm2e">"JEDEC Updates Groundbreaking High Bandwidth Memory (HBM) Standard." ''JEDEC'' (official), December 17, 2018. [https://www.jedec.org/news/pressreleases/jedec-updates-groundbreaking-high-bandwidth-memory-hbm-standard-0 jedec.org]. Retrieved July 2026.</ref><ref name="hbm3">"JEDEC Publishes HBM3 Update to High Bandwidth Memory (HBM) Standard." ''JEDEC'' (official), January 27, 2022. [https://www.jedec.org/news/pressreleases/jedec-publishes-hbm3-update-high-bandwidth-memory-hbm-standard jedec.org]. Retrieved July 2026.</ref><ref name="hbm4" />

{|
|+ HBM generations
|-
! Generation !! JEDEC standard !! Interface !! Peak bandwidth per stack
|-
| HBM || JESD235, October 2013 || 1,024-bit || 128 GB/s
|-
| HBM2 || JESD235A, announced January 2016 || 1,024-bit || 256 GB/s
|-
| HBM2E || JESD235B, announced December 2018 || 1,024-bit || 307 GB/s
|-
| HBM3 || JESD238, January 2022 || 1,024-bit || 819 GB/s
|-
| HBM3E || extension of JESD238 || 1,024-bit || about 1.2 TB/s
|-
| HBM4 || JESD270-4, April 2025 || 2,048-bit || 2 TB/s
|}

The first version reached 128 gigabytes per second per stack, and AMD put four stacks on the Radeon R9 Fury X in June 2015 to reach 512 gigabytes per second in total.<ref name="memforum" /><ref name="amd-fury" /> HBM2 doubled that and introduced the pseudo-channel arrangement still used today; the first product built on it was NVIDIA's Tesla P100 accelerator in 2016.<ref name="hbm2" /><ref name="p100">Harris, Mark. "Inside Pascal: NVIDIA's Newest Computing Platform." ''NVIDIA'' (official developer blog), April 5, 2016. [https://developer.nvidia.com/blog/inside-pascal/ nvidia.com]. Retrieved July 2026.</ref> A 2018 revision raised capacity to 24 gigabytes and allowed twelve-high stacks, and SK hynix began making 16-gigabyte parts at 3.6 gigabits per second in July 2020.<ref name="hbm2e" /><ref name="hbm2e-sk">"SK hynix Starts Mass Production of High-Speed DRAM, HBM2E." ''SK hynix Newsroom'' (official), July 2, 2020. [https://news.skhynix.com/en/sk-hynix-starts-mass-production-of-high-speed-dram-hbm2e/ news.skhynix.com]. Retrieved July 2026.</ref>

HBM3, published in January 2022, doubled the pin rate again to 6.4 gigabits per second and 819 gigabytes per second per device. It also cut the core voltage to 1.1 volts and added error correction on the die itself.<ref name="hbm3" /> The faster parts sold as HBM3E are not a separate JEDEC standard but an industry extension of HBM3; manufacturers were shipping them before the higher speed grades were formally settled.<ref name="hbm3e">Shilov, Anton. "SK hynix Samples 9 GT/s HBM3E." ''Tom's Hardware'', August 21, 2023. [https://www.tomshardware.com/news/sk-hynix-samples-9-gts-hbm3e-at-up-to-115-tbs-per-stack tomshardware.com]. Retrieved July 2026.</ref> SK hynix began volume production of a twelve-layer, 36-gigabyte HBM3E running at 9.6 gigabits per second in September 2024.<ref name="hbm3e-12">"SK hynix Begins Volume Production of the World's First 12-Layer HBM3E." ''SK hynix Newsroom'' (official), September 26, 2024. [https://news.skhynix.com/en/sk-hynix-begins-volume-production-of-the-world-first-12-layer-hbm3e/ news.skhynix.com]. Retrieved July 2026.</ref>

HBM4, published on 16 April 2025, is the biggest change since the format was invented. It doubles the interface to 2,048 bits and the channel count to 32, allows stacks of up to sixteen dies and 64 gigabytes, and adds a mechanism for defending against the Rowhammer attack.<ref name="hbm4" /> SK hynix announced it had finished developing HBM4 and was ready to manufacture it in September 2025, running above 10 gigabits per second — faster than the standard requires — with more than 40% better power efficiency.<ref name="sk-hbm4">"SK hynix Completes World's First HBM4 Development and Readies Mass Production." ''SK hynix Newsroom'' (official), September 12, 2025. [https://news.skhynix.com/en/sk-hynix-completes-worlds-first-hbm4-development-and-readies-mass-production/ news.skhynix.com]. Retrieved July 2026.</ref> Samsung shipped the first commercial HBM4 in February 2026, at 11.7 gigabits per second and 3.3 terabytes per second per stack.<ref name="samsung-hbm4" /> A further generation, HBM5, is in development at JEDEC; no specification has been published.<ref name="jedec-main">"Main Memory: DDR SDRAM, HBM." ''JEDEC'' (official). [https://www.jedec.org/category/technology-focus-area/main-memory-ddr-sdram jedec.org]. Retrieved July 2026.</ref>

== Where it is used ==

HBM began in graphics. AMD used it on the Fury X and then the Vega cards, and NVIDIA put it in the Tesla P100 for scientific computing.<ref name="amd-fury" /><ref name="p100" /> It never reached mainstream consumer graphics cards, which still use GDDR, because the packaging costs too much for the price bracket.<ref name="tf-cost" />

Machine learning made it essential. Training and running large models means moving vast quantities of numbers between memory and arithmetic units, and an accelerator starved of data sits idle no matter how fast it can calculate. Every serious AI accelerator now uses HBM, and demand from that one application reshaped the memory industry around it.<ref name="hbm4" /><ref name="tf-share">"Tight DRAM Supply Gives Suppliers Greater Pricing Power in HBM." ''TrendForce'', June 2, 2026. [https://www.trendforce.com/presscenter/news/20260602-13074.html trendforce.com]. Retrieved July 2026.</ref> In June 2026 NVIDIA certified all three memory makers to supply HBM4 for its Vera Rubin platform, the first time every supplier had been cleared for a flagship product at launch.<ref name="rubin">"NVIDIA Certifies Samsung, SK Hynix and Micron for Vera Rubin HBM4 Supply." ''Investing.com'', June 5, 2026. [https://www.investing.com/news/stock-market-news/nvidia-certifies-samsung-sk-hynix-and-micron-for-vera-rubin-hbm4-supply-4728612 investing.com]. Retrieved July 2026.</ref>

== The market ==

Only three companies make HBM, and [[SK hynix]] has led since the market became important. Counterpoint Research put its share of HBM revenue at 58% in the first quarter of 2026, with [[Samsung Electronics]] and [[Micron Technology]] on 21% each. That is a narrower lead than the 69% it held a year earlier.<ref name="counterpoint" />

Getting there took the others a long time. Samsung spent roughly eighteen months and several attempts qualifying its twelve-layer HBM3E with NVIDIA, finally passing in September 2025.<ref name="ked-samsung">"Samsung Clears Nvidia Hurdle for 12-Layer HBM3E Supply." ''KED Global'', September 19, 2025. [https://www.kedglobal.com/korean-chipmakers/newsView/ked202509190008 kedglobal.com]. Retrieved July 2026.</ref> Both it and Micron have moved faster on HBM4. Samsung passed a billion dollars of HBM4 revenue within about four months of starting production, and Micron reported shipping more than a billion dollars' worth by June 2026.<ref name="tf-split">"Memory Giants Split on HBM4 Strategy." ''TrendForce'', June 23, 2026. [https://www.trendforce.com/news/2026/06/23/news-memory-giants-split-on-hbm4-strategy-samsung-hbm4-sales-reportedly-tops-1b-sk-hynix-slows-ramp/ trendforce.com]. Retrieved July 2026.</ref><ref name="micron-q3">"Micron Technology, Inc. Reports Record Results for the Third Quarter." ''Micron Technology'' (official investor relations), June 24, 2026. [https://investors.micron.com/news-releases/news-release-details/micron-technology-inc-reports-record-results-third-quarter micron.com]. Retrieved July 2026.</ref>

HBM now consumes a large and growing slice of the world's DRAM production. TrendForce estimated it at about 18% of DRAM wafer input at the end of 2025, rising to roughly 22% by the end of 2026. That buys only about 9% of the bits produced, the gap being the wafer area each HBM bit costs.<ref name="tf-share" /> Squeezing ordinary memory out of the fabs this way is a large part of why conventional DRAM prices rose so sharply in 2026.<ref name="tf-share" />

That created an odd situation in pricing. HBM is sold on annual contracts, so its price did not move when conventional memory spiked; TrendForce reported that revenue per wafer for HBM was overtaken by ordinary server memory in the first quarter of 2026, and expects HBM contract prices to rise substantially in 2027 as suppliers reprice.<ref name="tf-share" /> Meanwhile SK hynix told investors in April 2026 that it expects HBM demand to run ahead of supply for at least three years.<ref name="kh-supply">"SK hynix Sees HBM Demand Outpacing Supply for Three Years." ''The Korea Herald'', April 23, 2026. [https://www.koreaherald.com/article/10723564 koreaherald.com]. Retrieved July 2026.</ref>

HBM has also become an instrument of trade policy. In December 2024 the United States imposed export controls covering high bandwidth memory, restricting sales to China both of American-made parts and of foreign-made parts caught by the rules on advanced computing.<ref name="bis">"Commerce Strengthens Export Controls to Restrict China's Capability to Produce Advanced Semiconductors." ''United States Bureau of Industry and Security'' (official), December 2, 2024. [https://www.bis.gov/press-release/commerce-strengthens-export-controls-restrict-chinas-capability-produce-advanced-semiconductors-military bis.gov]. Retrieved July 2026.</ref> Chinese manufacturers are working on their own: ChangXin Memory Technologies is reported to be targeting HBM3 production, though the country's makers remain several generations behind.<ref name="china-hbm">"Chinese Semiconductor Industry Gears Up for Domestic HBM3 Production." ''Tom's Hardware'', January 21, 2026. [https://www.tomshardware.com/pc-components/dram/chinese-semiconductor-industry-gears-up-for-domestic-hbm3-production-by-the-end-of-2026-cxmt-to-produce-chips-while-naura-maxwell-and-u-preseason-design-tools-for-assembly tomshardware.com]. Retrieved July 2026.</ref>

== See also ==

* [[Dynamic random-access memory]]
* [[Flash memory]]
* [[SK hynix]]
* [[Samsung Electronics]]
* [[Micron Technology]]

Loading editor…

{| cellpadding="7" style="max-width: 400px; width: 100%; border: 2px solid #176B5C; border-collapse: collapse; font-size: 0.9em;" |- | colspan="2" style="background: #176B5C; text-align: center; padding: 10px 8px 12px 8px; border-bottom: 2px solid #176B5C;" | <div style="color: #ffffff; font-size: 0.82em; letter-spacing: 0.08em;">COMPUTER MEMORY</div> <div style="color: #ffffff; font-weight: bold; font-size: 1.4em; margin: 3px 0 1px 0;">High Bandwidth Memory</div> <div style="color: #ffffff; font-size: 0.92em;">HBM</div> |- style="border-bottom: 1px solid #d8ebe6;" darkstyle="border-color: #2c2c2e;" ! scope="row" style="color: #176B5C; text-align: center; width: 36%;" darkstyle="color: color-mix(in srgb, #176B5C 55%, #f5f5f7);" | Type | Stacked [[Dynamic random-access memory|DRAM]]<ref name="skhynix-tsv">"Become a Semiconductor Expert with SK hynix — HBM." ''SK hynix Newsroom'' (official), May 2, 2023. [https://news.skhynix.com/become-a-semiconductor-expert-with-sk-hynix-hbm/ news.skhynix.com]. Retrieved July 2026.</ref> |- style="border-bottom: 1px solid #d8ebe6;" darkstyle="border-color: #2c2c2e;" ! scope="row" style="color: #176B5C; text-align: center;" darkstyle="color: color-mix(in srgb, #176B5C 55%, #f5f5f7);" | Standardised | October 2013 (JESD235)<ref name="memforum">O'Connor, Mike. "Highlights of the High-Bandwidth Memory (HBM) Standard." ''The Memory Forum'', June 14, 2014. [https://www-old.cs.utah.edu/thememoryforum/mike.pdf utah.edu]. Retrieved July 2026.</ref> |- style="border-bottom: 1px solid #d8ebe6;" darkstyle="border-color: #2c2c2e;" ! scope="row" style="color: #176B5C; text-align: center;" darkstyle="color: color-mix(in srgb, #176B5C 55%, #f5f5f7);" | First product | AMD Radeon R9 Fury X, June 2015<ref name="amd-fury">"AMD Radeon R9 Fury X: The World's First HBM-Powered Graphics Card." ''AMD'' (official), June 16, 2015. [https://ir.amd.com/news-events/press-releases/detail/619/ amd.com]. Retrieved July 2026.</ref> |- style="border-bottom: 1px solid #d8ebe6;" darkstyle="border-color: #2c2c2e;" ! scope="row" style="color: #176B5C; text-align: center;" darkstyle="color: color-mix(in srgb, #176B5C 55%, #f5f5f7);" | Current standard | HBM4 (JESD270-4, 2025)<ref name="hbm4">"JEDEC and Industry Leaders Collaborate to Release JESD270-4 HBM4 Standard." ''JEDEC'' (official), April 16, 2025. [https://www.jedec.org/news/pressreleases/jedec%C2%AE-and-industry-leaders-collaborate-release-jesd270-4-hbm4-standard-advancing jedec.org]. Retrieved July 2026.</ref> |- style="border-bottom: 1px solid #d8ebe6;" darkstyle="border-color: #2c2c2e;" ! scope="row" style="color: #176B5C; text-align: center;" darkstyle="color: color-mix(in srgb, #176B5C 55%, #f5f5f7);" | Used in | AI accelerators, supercomputers, some graphics cards<ref name="hbm4" /> |- | colspan="2" | {{Collapse|text="'''[ More details ▾ ]'''"|color="#176B5C"|style="width:100%;"}} |- style="border-bottom: 1px solid #d8ebe6;" darkstyle="border-color: #2c2c2e;" ! scope="row" style="color: #176B5C; text-align: center; width: 36%;" darkstyle="color: color-mix(in srgb, #176B5C 55%, #f5f5f7);" | Interface width | 1,024 bits (HBM to HBM3E)<br>2,048 bits (HBM4)<ref name="hbm4" /><ref name="memforum" /> |- style="border-bottom: 1px solid #d8ebe6;" darkstyle="border-color: #2c2c2e;" ! scope="row" style="color: #176B5C; text-align: center;" darkstyle="color: color-mix(in srgb, #176B5C 55%, #f5f5f7);" | Peak bandwidth | Up to 2 TB/s per stack (HBM4)<ref name="hbm4" /> |- style="border-bottom: 1px solid #d8ebe6;" darkstyle="border-color: #2c2c2e;" ! scope="row" style="color: #176B5C; text-align: center;" darkstyle="color: color-mix(in srgb, #176B5C 55%, #f5f5f7);" | Stack height | 4, 8, 12 or 16 dies<ref name="hbm4" /> |- style="border-bottom: 1px solid #d8ebe6;" darkstyle="border-color: #2c2c2e;" ! scope="row" style="color: #176B5C; text-align: center;" darkstyle="color: color-mix(in srgb, #176B5C 55%, #f5f5f7);" | Capacity | Up to 64 GB per stack<ref name="hbm4" /> |- ! scope="row" style="color: #176B5C; text-align: center;" darkstyle="color: color-mix(in srgb, #176B5C 55%, #f5f5f7);" | Makers | [[SK hynix]]<br>[[Samsung Electronics]]<br>[[Micron Technology]]<ref name="counterpoint">"Global DRAM and HBM Market Share: Quarterly." ''Counterpoint Research'', June 10, 2026. [https://counterpointresearch.com/en/insights/global-dram-and-hbm-market-share counterpointresearch.com]. Retrieved July 2026.</ref> {{Endcollapse}} |} '''High Bandwidth Memory''', or '''HBM''', is a form of [[Dynamic random-access memory|DRAM]] built by stacking memory chips on top of one another and wiring them together vertically. The stack sits beside the processor inside the same package, rather than out on the motherboard, and connects to it over an interface thousands of wires wide.<ref name="skhynix-tsv" /><ref name="hbm4" /> It is the memory that artificial-intelligence accelerators are built around, and the most valuable product the memory industry makes. The reason for all this trouble is bandwidth. A modern accelerator can perform arithmetic far faster than ordinary memory can supply numbers for it to work on, so the memory, not the processor, sets the pace. HBM attacks the problem from the opposite direction to conventional memory: instead of driving a narrow connection at a very high clock rate, it drives an extremely wide one comparatively slowly.<ref name="memforum" /> That turns out to use far less energy for each bit moved, which matters enormously when a data centre's electricity bill is the limiting factor.<ref name="memforum" /><ref name="amd-fury" /> HBM is an open standard, published by JEDEC, the industry body that also defines ordinary DDR memory.<ref name="hbm4" /> Work on it began around 2010, the first version was adopted in October 2013, and [[SK hynix]] developed the first product with AMD.<ref name="memforum" /><ref name="skhynix-story">"Continuing to Make HBM History: The Story of SK hynix's HBM Development." ''SK hynix Newsroom'' (official). [https://news.skhynix.com/en/the-story-of-sk-hynixs-hbm-development/ news.skhynix.com]. Retrieved July 2026.</ref> For its first decade it was a niche part for graphics cards and supercomputers. The AI boom changed that completely, and only three companies — SK hynix, [[Samsung Electronics]] and [[Micron Technology]] — can make it.<ref name="counterpoint" /> == Why it exists == Ordinary computer memory is connected by a narrow path driven very fast. A GDDR7 graphics memory chip, for instance, presents a 32-bit interface and pushes it to 32 gigabits per second on each pin, delivering about 128 gigabytes per second per chip.<ref name="gddr7">"Micron GDDR7 memory," product brief. ''Micron Technology'' (official). [https://assets.micron.com/adobe/assets/urn:aaid:aem:087330f6-6d71-4575-b622-cb10f20cdaf0/original/as/gddr7-product-brief.pdf micron.com]. Retrieved July 2026.</ref> Driving signals that fast across a circuit board is expensive in power, and the faster you go the worse it gets. HBM inverts the trade. An HBM4 stack presents 2,048 bits at a comparatively sedate 8 gigabits per second per pin, which yields up to two terabytes per second — roughly fifteen times a GDDR7 chip.<ref name="hbm4" /><ref name="gddr7" /> The original design was measured at around 6 to 7 picojoules for each bit moved, against 18 to 22 for the GDDR5 memory of the day.<ref name="memforum" /> When AMD shipped the first HBM graphics card it claimed 60% more bandwidth than GDDR5, more than three times the performance per watt, and 94% less board area.<ref name="amd-fury" /> The catch is that 2,048 wires cannot be routed across a circuit board. That constraint is what forces everything else about HBM: the stacking, the special packaging, and the cost. == How it is built == === Stacking and through-silicon vias === The dies in a stack are joined by through-silicon vias, copper connections etched straight down through a thinned wafer so that a chip can pass signals to the one above it.<ref name="skhynix-tsv" /> There are a great many of them: Samsung's twelve-layer packaging used more than 60,000 in a single stack while holding the whole package to 720 micrometres tall.<ref name="samsung-tsv">"Samsung Electronics Develops Industry's First 12-Layer 3D-TSV Chip Packaging Technology." ''Samsung'' (official newsroom), October 7, 2019. [https://news.samsung.com/us/samsung-12-layer-3d-tsv-chip-packaging-technology news.samsung.com]. Retrieved July 2026.</ref> Fitting more dies into that budget means grinding each one thinner. For its sixteen-layer HBM4, SK hynix thins the wafers to 30 micrometres, about a third the width of a human hair.<ref name="eetimes-ces26">"The State of HBM4 Chronicled at CES 2026." ''EE Times'', January 12, 2026. [https://www.eetimes.com/the-state-of-hbm4-chronicled-at-ces-2026/ eetimes.com]. Retrieved July 2026.</ref> === The base die === At the bottom of every stack sits a base die, sometimes called the logic die, which handles the traffic between the memory above it and the processor beside it. It used to be made on a memory process, but HBM4 changed that. SK hynix agreed with [[TSMC]] in April 2024 to have its HBM4 base die built on a logic foundry process, and the part now uses TSMC's 12-nanometre technology.<ref name="tsmc-mou">"SK hynix Partners With TSMC to Strengthen HBM Technological Leadership." ''SK hynix Newsroom'' (official), April 19, 2024. [https://news.skhynix.com/sk-hynix-partners-with-tsmc-to-strengthen-hbm-technological-leadership/ news.skhynix.com]. Retrieved July 2026.</ref><ref name="eetimes-ces26" /> Samsung took the opposite route, building its HBM4 base die on its own four-nanometre foundry process, which makes it the only supplier that controls the entire stack.<ref name="samsung-hbm4">"Samsung Ships Industry-First Commercial HBM4." ''Samsung'' (official newsroom), February 12, 2026. [https://news.samsung.com/global/samsung-ships-industry-first-commercial-hbm4 news.samsung.com]. Retrieved July 2026.</ref> Micron has contracted TSMC to make the base die for its next generation.<ref name="micron-tsmc">Shilov, Anton. "Micron Teams Up With TSMC to Deliver HBM4E, Targeted for 2027." ''Tom's Hardware'', September 25, 2025. [https://www.tomshardware.com/micron-hands-tsmc-the-keys-to-hbm4e tomshardware.com]. Retrieved July 2026.</ref> A logic base die also opens the door to customisation: SK hynix has said it intends to move beyond standard parts to memory tailored to individual customers.<ref name="tsmc-sym">"SK hynix at the TSMC Technology Symposium 2026." ''SK hynix Newsroom'' (official), April 23, 2026. [https://news.skhynix.com/en/tsmc-technology-symposium-2026/ news.skhynix.com]. Retrieved July 2026.</ref> === The interposer === The stacks and the processor are mounted side by side on a slab of silicon called an interposer, which carries the thousands of connections between them. This arrangement is known as 2.5D packaging. The dominant version is TSMC's CoWoS, short for chip on wafer on substrate, which places logic chips and HBM stacks together over a large silicon interposer.<ref name="cowos">"CoWoS." ''TSMC'' (official), 3DFabric technology. [https://3dfabric.tsmc.com/english/dedicatedFoundry/technology/cowos.htm tsmc.com]. Retrieved July 2026.</ref> Interposer capacity has been a hard limit on how many AI accelerators the world can build. TrendForce put the gap between demand and supply for TSMC's packaging at about 20% in mid-2026, narrowing to roughly 10% by the end of the year as capacity comes online.<ref name="tf-cowos">"TSMC CoWoS Supply-Demand Gap Reportedly Seen Narrowing From 20% to 10% by End-2026." ''TrendForce'', June 15, 2026. [https://www.trendforce.com/news/2026/06/15/news-tsmc-cowos-supply-demand-gap-reportedly-seen-narrowing-from-20-to-10-by-end-2026-as-capacity-expands/ trendforce.com]. Retrieved July 2026.</ref> JEDEC published a variant in June 2026 with a narrower 512-bit interface, meant to let cheaper designs use an ordinary organic substrate instead of silicon.<ref name="sphbm4">"JEDEC Releases New SP-HBM4 Standard." ''Tom's Hardware'', 2026. [https://www.tomshardware.com/pc-components/dram/jedec-releases-new-sphbm4-standard-to-slash-ai-memory-costs-narrow-512-bit-interface-enables-dropping-expensive-interposers-for-organic-substrates tomshardware.com]. Retrieved July 2026.</ref> === Bonding, heat and cost === How the dies are joined matters more than it sounds. SK hynix uses a method it calls MR-MUF, which heats and connects every chip in the stack at once and fills the gaps with a moulding compound in the same step. The alternative, TC-NCF, lays a film between chips and bonds them one layer at a time.<ref name="mrmuf">"Rulebreakers' Revolutions: MR-MUF Unlocks HBM Heat Control." ''SK hynix Newsroom'' (official), July 30, 2024. [https://news.skhynix.com/rulebreaker-revolutions-mr-muf-unlocks-hbm-heat-control/ news.skhynix.com]. Retrieved July 2026.</ref> SK hynix credits its method with better heat dissipation, and says a refined version raised the thermal conductivity of the compound by more than half.<ref name="mrmuf" /><ref name="eetimes-mrmuf">"SK hynix's MR-MUF Innovations Tackle Heat Generation to Secure HBM Leadership." ''EE Times'', December 18, 2024. [https://www.eetimes.com/sk-hynixs-mr-muf-innovations-tackle-heat-generation-to-secure-hbm-leadership/ eetimes.com]. Retrieved July 2026.</ref> Heat is a real constraint, because a stack of memory sits millimetres from a processor running near its thermal limit and the dies in the middle have nowhere to send their heat. Researchers at imec simulated putting HBM directly on top of a graphics processor rather than beside it and found the assembly reached 140 °C, hot enough to stop working.<ref name="imec">"The Ultimate 3D Integration Would Cook Future GPUs." ''IEEE Spectrum'', January 14, 2026. [https://spectrum.ieee.org/hbm-on-gpu-imec-iedm spectrum.ieee.org]. Retrieved July 2026.</ref> Hybrid bonding, which would do away with the solder bumps between dies altogether, has been expected as the answer for the tallest stacks. It was not used in HBM4, and reports in July 2026 suggest sixteen-layer HBM4E is now the earliest likely adoption.<ref name="tf-hybrid">"Samsung, SK hynix Reportedly Reconsider Hybrid Bonding Timeline." ''TrendForce'', July 7, 2026. [https://www.trendforce.com/news/2026/07/07/news-samsung-sk-hynix-reportedly-reconsider-hybrid-bonding-timeline-16-high-hbm4e-may-be-earliest-adoption/ trendforce.com]. Retrieved July 2026.</ref> All of this is expensive. A gigabyte of HBM consumes more than three times the wafer area of a gigabyte of ordinary DRAM, so making it eats capacity that would otherwise produce far more memory.<ref name="semi">"From Latency to Reaction: Simulating the Next Wafer Demand Inflection." ''SEMI'', August 11, 2025. [https://www.semi.org/en/blogs/from-latency-to-reaction-simulating-the-next-wafer-demand-inflection semi.org]. Retrieved July 2026.</ref> TrendForce estimated HBM4 wafers at US$7,000 to US$8,000, three to four times the cost of conventional DRAM wafers.<ref name="tf-cost">"Advancement to HBM4 Will Entail Higher Costs With Price Premium Estimated to Exceed 30%." ''TrendForce'', May 9, 2025. [https://www.trendforce.com/research/download/RP250509XF trendforce.com]. Retrieved July 2026.</ref> == Generations == Each generation has roughly doubled the bandwidth of the one before, at first by raising the signalling rate and, with HBM4, by widening the interface.<ref name="memforum" /><ref name="hbm2">"JEDEC Updates Groundbreaking High Bandwidth Memory (HBM) Standard." ''JEDEC'' (official), January 12, 2016. [https://www.jedec.org/news/pressreleases/jedec-updates-groundbreaking-high-bandwidth-memory-hbm-standard jedec.org]. Retrieved July 2026.</ref><ref name="hbm2e">"JEDEC Updates Groundbreaking High Bandwidth Memory (HBM) Standard." ''JEDEC'' (official), December 17, 2018. [https://www.jedec.org/news/pressreleases/jedec-updates-groundbreaking-high-bandwidth-memory-hbm-standard-0 jedec.org]. Retrieved July 2026.</ref><ref name="hbm3">"JEDEC Publishes HBM3 Update to High Bandwidth Memory (HBM) Standard." ''JEDEC'' (official), January 27, 2022. [https://www.jedec.org/news/pressreleases/jedec-publishes-hbm3-update-high-bandwidth-memory-hbm-standard jedec.org]. Retrieved July 2026.</ref><ref name="hbm4" /> {| |+ HBM generations |- ! Generation !! JEDEC standard !! Interface !! Peak bandwidth per stack |- | HBM || JESD235, October 2013 || 1,024-bit || 128 GB/s |- | HBM2 || JESD235A, announced January 2016 || 1,024-bit || 256 GB/s |- | HBM2E || JESD235B, announced December 2018 || 1,024-bit || 307 GB/s |- | HBM3 || JESD238, January 2022 || 1,024-bit || 819 GB/s |- | HBM3E || extension of JESD238 || 1,024-bit || about 1.2 TB/s |- | HBM4 || JESD270-4, April 2025 || 2,048-bit || 2 TB/s |} The first version reached 128 gigabytes per second per stack, and AMD put four stacks on the Radeon R9 Fury X in June 2015 to reach 512 gigabytes per second in total.<ref name="memforum" /><ref name="amd-fury" /> HBM2 doubled that and introduced the pseudo-channel arrangement still used today; the first product built on it was NVIDIA's Tesla P100 accelerator in 2016.<ref name="hbm2" /><ref name="p100">Harris, Mark. "Inside Pascal: NVIDIA's Newest Computing Platform." ''NVIDIA'' (official developer blog), April 5, 2016. [https://developer.nvidia.com/blog/inside-pascal/ nvidia.com]. Retrieved July 2026.</ref> A 2018 revision raised capacity to 24 gigabytes and allowed twelve-high stacks, and SK hynix began making 16-gigabyte parts at 3.6 gigabits per second in July 2020.<ref name="hbm2e" /><ref name="hbm2e-sk">"SK hynix Starts Mass Production of High-Speed DRAM, HBM2E." ''SK hynix Newsroom'' (official), July 2, 2020. [https://news.skhynix.com/en/sk-hynix-starts-mass-production-of-high-speed-dram-hbm2e/ news.skhynix.com]. Retrieved July 2026.</ref> HBM3, published in January 2022, doubled the pin rate again to 6.4 gigabits per second and 819 gigabytes per second per device. It also cut the core voltage to 1.1 volts and added error correction on the die itself.<ref name="hbm3" /> The faster parts sold as HBM3E are not a separate JEDEC standard but an industry extension of HBM3; manufacturers were shipping them before the higher speed grades were formally settled.<ref name="hbm3e">Shilov, Anton. "SK hynix Samples 9 GT/s HBM3E." ''Tom's Hardware'', August 21, 2023. [https://www.tomshardware.com/news/sk-hynix-samples-9-gts-hbm3e-at-up-to-115-tbs-per-stack tomshardware.com]. Retrieved July 2026.</ref> SK hynix began volume production of a twelve-layer, 36-gigabyte HBM3E running at 9.6 gigabits per second in September 2024.<ref name="hbm3e-12">"SK hynix Begins Volume Production of the World's First 12-Layer HBM3E." ''SK hynix Newsroom'' (official), September 26, 2024. [https://news.skhynix.com/en/sk-hynix-begins-volume-production-of-the-world-first-12-layer-hbm3e/ news.skhynix.com]. Retrieved July 2026.</ref> HBM4, published on 16 April 2025, is the biggest change since the format was invented. It doubles the interface to 2,048 bits and the channel count to 32, allows stacks of up to sixteen dies and 64 gigabytes, and adds a mechanism for defending against the Rowhammer attack.<ref name="hbm4" /> SK hynix announced it had finished developing HBM4 and was ready to manufacture it in September 2025, running above 10 gigabits per second — faster than the standard requires — with more than 40% better power efficiency.<ref name="sk-hbm4">"SK hynix Completes World's First HBM4 Development and Readies Mass Production." ''SK hynix Newsroom'' (official), September 12, 2025. [https://news.skhynix.com/en/sk-hynix-completes-worlds-first-hbm4-development-and-readies-mass-production/ news.skhynix.com]. Retrieved July 2026.</ref> Samsung shipped the first commercial HBM4 in February 2026, at 11.7 gigabits per second and 3.3 terabytes per second per stack.<ref name="samsung-hbm4" /> A further generation, HBM5, is in development at JEDEC; no specification has been published.<ref name="jedec-main">"Main Memory: DDR SDRAM, HBM." ''JEDEC'' (official). [https://www.jedec.org/category/technology-focus-area/main-memory-ddr-sdram jedec.org]. Retrieved July 2026.</ref> == Where it is used == HBM began in graphics. AMD used it on the Fury X and then the Vega cards, and NVIDIA put it in the Tesla P100 for scientific computing.<ref name="amd-fury" /><ref name="p100" /> It never reached mainstream consumer graphics cards, which still use GDDR, because the packaging costs too much for the price bracket.<ref name="tf-cost" /> Machine learning made it essential. Training and running large models means moving vast quantities of numbers between memory and arithmetic units, and an accelerator starved of data sits idle no matter how fast it can calculate. Every serious AI accelerator now uses HBM, and demand from that one application reshaped the memory industry around it.<ref name="hbm4" /><ref name="tf-share">"Tight DRAM Supply Gives Suppliers Greater Pricing Power in HBM." ''TrendForce'', June 2, 2026. [https://www.trendforce.com/presscenter/news/20260602-13074.html trendforce.com]. Retrieved July 2026.</ref> In June 2026 NVIDIA certified all three memory makers to supply HBM4 for its Vera Rubin platform, the first time every supplier had been cleared for a flagship product at launch.<ref name="rubin">"NVIDIA Certifies Samsung, SK Hynix and Micron for Vera Rubin HBM4 Supply." ''Investing.com'', June 5, 2026. [https://www.investing.com/news/stock-market-news/nvidia-certifies-samsung-sk-hynix-and-micron-for-vera-rubin-hbm4-supply-4728612 investing.com]. Retrieved July 2026.</ref> == The market == Only three companies make HBM, and [[SK hynix]] has led since the market became important. Counterpoint Research put its share of HBM revenue at 58% in the first quarter of 2026, with [[Samsung Electronics]] and [[Micron Technology]] on 21% each. That is a narrower lead than the 69% it held a year earlier.<ref name="counterpoint" /> Getting there took the others a long time. Samsung spent roughly eighteen months and several attempts qualifying its twelve-layer HBM3E with NVIDIA, finally passing in September 2025.<ref name="ked-samsung">"Samsung Clears Nvidia Hurdle for 12-Layer HBM3E Supply." ''KED Global'', September 19, 2025. [https://www.kedglobal.com/korean-chipmakers/newsView/ked202509190008 kedglobal.com]. Retrieved July 2026.</ref> Both it and Micron have moved faster on HBM4. Samsung passed a billion dollars of HBM4 revenue within about four months of starting production, and Micron reported shipping more than a billion dollars' worth by June 2026.<ref name="tf-split">"Memory Giants Split on HBM4 Strategy." ''TrendForce'', June 23, 2026. [https://www.trendforce.com/news/2026/06/23/news-memory-giants-split-on-hbm4-strategy-samsung-hbm4-sales-reportedly-tops-1b-sk-hynix-slows-ramp/ trendforce.com]. Retrieved July 2026.</ref><ref name="micron-q3">"Micron Technology, Inc. Reports Record Results for the Third Quarter." ''Micron Technology'' (official investor relations), June 24, 2026. [https://investors.micron.com/news-releases/news-release-details/micron-technology-inc-reports-record-results-third-quarter micron.com]. Retrieved July 2026.</ref> HBM now consumes a large and growing slice of the world's DRAM production. TrendForce estimated it at about 18% of DRAM wafer input at the end of 2025, rising to roughly 22% by the end of 2026. That buys only about 9% of the bits produced, the gap being the wafer area each HBM bit costs.<ref name="tf-share" /> Squeezing ordinary memory out of the fabs this way is a large part of why conventional DRAM prices rose so sharply in 2026.<ref name="tf-share" /> That created an odd situation in pricing. HBM is sold on annual contracts, so its price did not move when conventional memory spiked; TrendForce reported that revenue per wafer for HBM was overtaken by ordinary server memory in the first quarter of 2026, and expects HBM contract prices to rise substantially in 2027 as suppliers reprice.<ref name="tf-share" /> Meanwhile SK hynix told investors in April 2026 that it expects HBM demand to run ahead of supply for at least three years.<ref name="kh-supply">"SK hynix Sees HBM Demand Outpacing Supply for Three Years." ''The Korea Herald'', April 23, 2026. [https://www.koreaherald.com/article/10723564 koreaherald.com]. Retrieved July 2026.</ref> HBM has also become an instrument of trade policy. In December 2024 the United States imposed export controls covering high bandwidth memory, restricting sales to China both of American-made parts and of foreign-made parts caught by the rules on advanced computing.<ref name="bis">"Commerce Strengthens Export Controls to Restrict China's Capability to Produce Advanced Semiconductors." ''United States Bureau of Industry and Security'' (official), December 2, 2024. [https://www.bis.gov/press-release/commerce-strengthens-export-controls-restrict-chinas-capability-produce-advanced-semiconductors-military bis.gov]. Retrieved July 2026.</ref> Chinese manufacturers are working on their own: ChangXin Memory Technologies is reported to be targeting HBM3 production, though the country's makers remain several generations behind.<ref name="china-hbm">"Chinese Semiconductor Industry Gears Up for Domestic HBM3 Production." ''Tom's Hardware'', January 21, 2026. [https://www.tomshardware.com/pc-components/dram/chinese-semiconductor-industry-gears-up-for-domestic-hbm3-production-by-the-end-of-2026-cxmt-to-produce-chips-while-naura-maxwell-and-u-preseason-design-tools-for-assembly tomshardware.com]. Retrieved July 2026.</ref> == See also == * [[Dynamic random-access memory]] * [[Flash memory]] * [[SK hynix]] * [[Samsung Electronics]] * [[Micron Technology]]