Weekly signal for the people building and buying AI infrastructure: what moved, why it matters, what's next.
DeepSeek spent this week doing something more interesting than shipping a faster model. It shipped a smaller one, at least on the memory side, claiming its new V4.1 Flash needs 75% less HBM and 87.5% less SSD capacity for its key-value cache than its own prior architecture. Samsung and SK hynix's stock reaction was muted but real, the first genuinely quantified pushback this shortage cycle has faced. In a separate but well-timed coincidence, TrendForce data landed showing China's CXMT posting a gross margin ahead of both Micron and SK hynix this quarter, using older lithography tools under a full export-control regime. Two stories asking the same question from opposite directions: is the memory crunch really as one-way as it has looked all year? Plus DRAM's biggest quarterly revenue jump yet, a new JEDEC memory-module standard, and Solidigm's IPO clock still ticking.
A persistent line on where the shortage stands, present every issue whether or not the picture actually moved.
Direction: Worsening.
This period: TrendForce logged 2Q26 DRAM industry revenue at $154.73 billion, up 59.5% quarter over quarter, explicitly attributing the jump to supply expansion continuing to lag demand growth with supplier inventories at historic lows. Enterprise SSD vendor revenue told a similar story, up 103.6% QoQ to $37.59 billion combined across the top five. The counter-signal: DeepSeek's September 10 release of V4.1 Flash claims a 75% cut in HBM need and an 87.5% cut in SSD need for its key-value cache versus its own prior architecture, which knocked Samsung and SK hynix shares down in Seoul trading on September 11, the first credible demand-side pushback this shortage narrative has faced.
Driver: AI hyperscaler demand for DRAM, NAND, and HBM is outrunning capacity even as suppliers post record revenue; HBM production is still reallocating fab capacity away from conventional DRAM and NAND, tightening both further, per TrendForce's own framing of the 2Q26 numbers.
Watch for: Whether DeepSeek's more efficient KV-cache architecture gets replicated by other frontier labs at scale and actually shows up in bulk order data, alongside Q3/Q4 2026 capacity guidance from Samsung, SK hynix, and Micron.
A running index of a few figures we track issue over issue, so the trend is visible, not just the snapshot. Two fresh readings clear the bar this week: DDR4 and DDR5 spot pricing, both dated September 11 off TrendForce's DataTrack service. Nothing new on the 30TB SSD list price or the 512Gb TLC NAND wafer front, so those rows carry forward unchanged.
| Issue | Date | Metric | Value |
|---|---|---|---|
| Issue 03 | Aug 30, 2026 | 30TB enterprise SSD list price | $22,600 |
| Issue 04 | Sep 4, 2026 | 30TB enterprise SSD list price | $22,600 (flat) |
| Issue 05 | Sep 1, 2026 | DDR4 1Gx8 3200MT/s spot price | $44.54 (+2.08% WoW) |
| Issue 05 | Aug 31, 2026 | 512Gb TLC NAND wafer spot price | $20.71 (-0.90% WoW) |
| Issue 07 | Sep 11, 2026 | DDR4 1Gx8 3200MT/s spot price | $45.21 (-0.14% WoW) |
| Issue 07 | Sep 11, 2026 | DDR5 16Gb (2Gx8) 4800/5600 spot price | $54.33 (flat WoW) |
Five things that happened this week, and why I'd pay attention to each one.
DeepSeek released V4.1 Flash on September 10, and the headline number is not a benchmark score. The company says the model's key-value cache, the working memory an AI system holds onto mid-conversation, needs 75% less HBM and 87.5% less SSD capacity than its own prior-generation architecture required. Samsung fell 3.5% and SK hynix fell 2.2% in Seoul trading the next day; Micron and SanDisk held steady in US trading, partly cushioned by unrelated news of record Micron employee bonuses in Taiwan that same day.
TrendForce's Q2 2026 DRAM tracker landed September 7 with the industry's largest quarterly revenue jump of the cycle so far: $154.73 billion, up 59.5% quarter over quarter, with supplier inventories described as being at historic lows and most new supply earmarked for servers. Samsung took $60.98 billion of that, a 39.4% share, up 63.4% QoQ on early HBM4 shipments. SK hynix posted $38.59 billion (up 37.9%), and Micron grew fastest of the three majors at 65.5% QoQ to $36.0 billion.
The enterprise SSD side told a similar story a week earlier, published September 1. Combined revenue for the top five vendors hit $37.59 billion in Q2 2026, up 103.6% quarter over quarter: Samsung led at roughly $14.35 billion, SK hynix Group (including Solidigm) above $8.63 billion, Micron near $6.98 billion (up 126.3%), Kioxia at $4.64 billion, and SanDisk near $2.98 billion (up 102.9%). TrendForce credits both rising shipment volumes and higher contract prices, plus cloud providers shifting from PCIe 4.0 to PCIe 5.0 and large GB-series AI server rack deployments.
Responding September 8 to Korean media reports of a roughly 5 trillion won pre-IPO raise, SK hynix said only that "no matters have been determined," while reaffirming its pledge from an August 5 disclosure to update markets on specifics within three months, a window that now runs out around November 5.
JEDEC published JESD328, the SOCAMM2 Common Standard, in June 2026, turning what began as an Nvidia-originated compression-mount memory design into a spec any memory maker can build to. All three merchant DRAM makers have followed with their own modules; Samsung says its version delivers more than twice the bandwidth of a conventional RDIMM at over 55% less power, aimed at both air- and liquid-cooled Nvidia-based inference servers.
A running snapshot, updated whenever a vendor discloses something new, not re-explained from scratch every week. No vendor here disclosed a new HBM roadmap item this issue, so all three cards carry forward unchanged.
zHBM concept now quantified: roughly 8x HBM5 performance, more than 10x the memory density, 3x the energy efficiency, and under half the thermal resistance, by stacking HBM directly on the accelerator die instead of beside it on an interposer. Still no committed date past "after 2029."
Roadmap detailedHybrid bonding pushed from HBM4E to HBM5 after hitting a 775-micron packaging ceiling. Racing for 16-Hi HBM4 delivery to Nvidia by Q4 2026.
DelayedReportedly adding up to 60K HBM wafers per month toward roughly 100K by year end, with 12-Hi HBM4 for Vera Rubin heading toward half of output. Still racing for 16-Hi HBM4 by Q4 2026.
Capacity rampA card per tracked storage systems vendor, ranked from the latest named analyst report, touched only when a fresh report actually drops. No new IDC or Gartner report landed this issue, so these entries still reflect IDC's Q1 2026 tracker and the 2026 Gartner Magic Quadrant.
Broadest portfolio in the market; leaning on an AI-storage attach strategy across PowerScale and PowerStore to ride server deals into storage revenue.
Last updated Issue 01Slipped from 2nd to behind Huawei and HPE in the 2026 Magic Quadrant. AFX disaggregated architecture and the new AI Data Engine (AIDE); DGX SuperPOD-certified.
Last updated Issue 03Formerly Pure Storage, renamed February 2026. Number one on both Magic Quadrant axes for the second straight year; climbed to third on subscription-model adoption and AI-optimized platform revenue.
Last updated Issue 03Strong outside North America; among the fastest-growing suppliers by IDC count over the past two trackers.
Last updated Issue 01Folding storage into its broader AI factory and GreenLake positioning.
Last updated Issue 01IBM Storage Scale holds roughly 17% of the parallel file system market specifically; Storage Scale System 6000 is NVIDIA-certified for metadata-heavy training jobs.
Last updated Issue 01The Storage and Memory Signal reaches people who actually buy and operate AI storage and memory infrastructure, AI DevOps engineers, infra leads, and the executives they report to. If that's your buyer, this slot is available.
V4.1 Flash claims a fraction of the memory footprint of DeepSeek's own prior model. The number is real. Whether it moves the market is a different question.
DeepSeek released V4.1 Flash on September 10, and unlike most model launches this year, the number everyone latched onto wasn't a benchmark score. It was a memory figure. The company says the model's key-value cache, the running record of attention state an AI system keeps for every token in a conversation, needs 75% less HBM and 87.5% less SSD capacity than DeepSeek's own prior-generation architecture required to do the same job. Samsung fell 3.5% and SK hynix fell 2.2% in Seoul trading the next day. Micron and SanDisk shares held steady in the US, helped along by unrelated news that Micron was handing its Taiwan workforce record bonuses the same day, but the Korean pair's exposure to HBM specifically is exactly why they moved and the American pair didn't.
The mechanism is worth walking through because it's more specific than "we made it smaller." CSA2, short for Compressed Sparse Attention 2, assigns each attention layer a static mode, Full, Reindex, or Reuse, so layers share KV data and reuse sparse-attention indices instead of recomputing them from scratch. On top of that sits FP4 quantization in the E2M1 format with per-16-channel scaling, squeezing the cache further without a separate quantization pass. A third technique, which DeepSeek calls SWA Bounded Replay, handles sliding-window attention by replaying just the most recent token window to reconstruct context, skipping the SSD round-trip that a naive implementation would need. Stack all three and DeepSeek gets to an 890-byte-per-token footprint, about a quarter of what V4 Flash needed and a small fraction of what the original V1 needed.
Read the claim for exactly what it says, not more. This is a reduction in KV cache footprint during inference, not a claim that the whole model or an entire data center now runs on a quarter of the memory. And the comparison is against DeepSeek's own prior generation, not against Nvidia's reference stack or any competitor's architecture. The model also only leads rivals on "certain coding and AI agent-related benchmarks," per DeepSeek's own framing, not across the board. None of that makes the underlying engineering less real. It just means the headline percentages describe one company's internal improvement, not an industry baseline shift.
What makes this issue's news cycle interesting is how directly it argues with a run of stories this newsletter has already covered. Issue 02's Uplevel Highlight explained KV cache and covered Nvidia's ICMSP standard for pushing overflow cache out to NVMe. Issue 05 covered Kioxia's plan to pair fast NAND with a CXL controller as a partial DRAM substitute. Issue 06's Second Cut covered Silicon Motion pitching enterprise SSDs as a persistent memory tier built specifically to hold KV cache that outgrows onboard HBM. Every one of those stories assumed the cache keeps growing and that the fix is a bigger, cheaper tier to park it in. DeepSeek's architecture attacks the premise directly: shrink the cache instead of building more places to put it.
Whether that argument wins is a separate question from whether it's true. AI efficiency gains have a track record of getting absorbed by more usage rather than shrinking aggregate demand; cheaper inference tends to invite more inference, not less total memory consumption industry-wide. And this is one lab's claim about its own model. What would actually move bulk HBM and NAND orders is OpenAI, Anthropic, Google, or Meta adopting comparable cache-shrinking tricks at their own frontier scale, not one efficient release from one lab. But this is the first genuinely quantified, named-technique challenge this shortage cycle has had to answer, and a 3.5% one-day stock move, muted as it looks against a year of relentless gains, is the market saying the thesis isn't bulletproof either.
A 10% global share and an 87.6% gross margin in the same quarter. Export controls were supposed to keep both numbers smaller.
Counterpoint Research's Q2 2026 DRAM tracker, reported September 3, put ChangXin Memory Technologies at a 10% global bit-share, up from 4% a year earlier, behind Samsung's 38%, SK hynix's 25%, and Micron's 24%. Share gains from a Chinese supplier operating under a full US export-control regime aren't new; this newsletter noted CXMT's rise in earlier issues. What's new, and harder to wave off, is the profitability figure TrendForce published four days earlier.
An 87.6% gross margin, ahead of two of the three merchant DRAM incumbents, from a company restricted to older lithography tools, is the real story here, not the share number by itself. Some caution belongs in that read. CXMT only listed on Shanghai's STAR Market in July, so its numbers haven't been tested across a full pricing cycle yet, and the same industry-wide ASP surge lifting Samsung's, SK hynix's, and Micron's margins this quarter is lifting CXMT's too. An 873.64% year-over-year revenue jump is also easier to post off a small base than a large one. None of that erases the margin comparison, but it argues for treating this as one very strong quarter rather than proof CXMT has closed the operational gap with the incumbents for good.
The LPDDR6 claims are where the story gets genuinely murky. CXMT's own language is cautious, sampling with key customers, accelerating preparations. Reuters reports mass production is already underway specifically for Xiaomi's upcoming 18 Fold, and Xiaomi founder Lei Jun has publicly confirmed that phone will be the first to ship with the new memory. That's a real gap between what the company says about itself and what its own customer's supply chain appears to already be doing. Independent analysts quoted alongside the story flagged that yields and volumes remain undisclosed either way, which is the detail that actually matters before anyone calls this parity with Samsung or SK hynix.
One piece of storage or memory vocabulary, explained properly, every week.
In plain English: a memory module for AI servers that plugs in and swaps out like an expansion card, but is built from the same low-power memory type found in phones, not the power-hungry kind a normal server uses.
Server memory has historically forced a choice. Solder LPDDR directly onto the board, the way phones and laptops do, and you get excellent power efficiency and bandwidth density, but a dead chip means replacing the whole board. Use standard swappable RDIMM instead, the way servers have for decades, and a technician can pull a failed module in minutes, but RDIMM burns more power and delivers less bandwidth per pin than LPDDR does. Nvidia's answer, first shown in 2025 for its GB200-class systems, was SOCAMM: Small Outline Compression-Attached Memory Module. It puts LPDDR5X on a small card that clips into a compression-mount socket instead of solder, keeping the power and bandwidth advantage while getting serviceability back.
SOCAMM2 is what happened after JEDEC took the idea over. The organization published JESD328, the SOCAMM2 Common Standard, in June 2026, following a Raw Card A annex the previous month, turning a single vendor's design into a spec any memory maker can build to. All three merchant DRAM makers followed within the year. Samsung's version claims more than double the bandwidth of a conventional RDIMM at over 55% less power, aimed at both air- and liquid-cooled Nvidia-based inference servers. Micron and SK hynix have shown or shipped their own SOCAMM2 parts as well, with Micron's 192GB module tied to Nvidia's Vera Rubin platform.
The number worth sitting with is the power figure, not the bandwidth one. This newsletter's Issue 05 covered Google's claim that memory now accounts for more than 75% of an AI server's hardware bill of materials. A growing share of that memory bill is shipping as SOCAMM2 rather than classic RDIMM, and a verified 55%-plus reduction in power draw per module is exactly the kind of performance-per-watt data point that's otherwise hard to find consistently reported across this industry. A socket that lets a data center swap failed memory without desoldering a board sounds like a minor mechanical detail. It's actually the thing standing between "phone-efficient memory" and "serviceable at data center scale," which is precisely the kind of unglamorous standard that ends up deciding how many racks of DRAM a given power budget can support.
AI Infra Summit 2026, Santa Clara. About as close as this space gets to a dedicated conference, and now just two days out. Worth watching whether any vendor addresses the DeepSeek efficiency claim directly from the stage.
Micron fiscal Q4 2026 earnings. The first hard numbers on how much of the reported 60K-wafer HBM capacity ramp actually materialized, and Micron's first public chance to respond to DeepSeek's memory-efficiency claims.
SK hynix's self-imposed three-month window to give markets specifics on Solidigm's strategic review runs out, per its August 5 disclosure.
OCP Global Summit 2026, San Jose McEnery Convention Center. The Open Compute Project's flagship event, themed "Scaling Innovation for the AI Era," and the last one before the Summit relocates to San Francisco's Moscone Center starting in 2027.