The Latency Wall Has Fallen
For years, the promise of AI-generated websites has collided with a simple physical constraint: users will not wait. Marketing teams know that every additional second of page load time bleeds conversion rates, which meant that real-time, per-user website generation — however theoretically appealing — was commercially non-viable. The math was unforgiving. If a large language model takes five seconds to compose a page, the user has already left.
That calculus has now changed. According to Carlos Sanchez, principal scientist at Adobe working on Adobe Experience Manager, speaking on the AI Engineer podcast, his team has brought full page generation down to just over one second. The figure is not a prototype aspiration but a measured benchmark: using Cerebras inference hardware running Google’s Gemma 4 model, average page generation latency came in at 1.1 seconds. The next-best provider took 4.6 seconds.
Sanchez frames the dual criteria in plain operational terms. “We look for two things. Accuracy. That’s typically what people look for, but also we want the speed because we don’t want the site generation to take more than 1 or 2 seconds, right? Because people this is already proven that people want the faster the site, the more conversions it generates or the better the experience it is for the user.”
The speed gap that Sanchez demonstrated is not incremental. It is the difference between a feature that feels responsive and one that feels broken in a modern web context. His live benchmark told the story directly: a query for “a coffee machine to prepare coffee while camping” generated a fully personalized page in 1.64 seconds total round-trip, with the LLM call itself consuming roughly one second at 2,300 tokens per second. A second run confirmed the consistency with 2,200 tokens per second.
| Provider / Model | Average Page Generation Latency |
|---|---|
| Cerebras + Gemma 4 | 1.1 seconds |
| Next-best provider | 4.6 seconds |
| Other providers tested | 4+ seconds, varying by task |
“We get 2,300 tokens per second. Which is not bad. I would say. This is something that we only dreamed about before,” he noted.
The strategic insight underlying this choice is counterintuitive in an era of ever-larger models. Sanchez argues that site generation does not require a frontier-scale LLM. “You don’t need a huge LLM to do this sort of work because you are generating text, you are deciding where to put blocks and how to organize the website, you don’t need a lots of information for that.”
Architecture: Grounded Generation, Not Blank-Page Fantasy
The most important design decision Sanchez made was to reject the idea of generating entire websites from scratch. Marketing organizations have strict brand guidelines, and hallucination risk in customer-facing copy is unacceptable. Instead, the system personalizes discrete blocks — hero cards, product feeds, navigation menus, calls-to-action — while grounding all generated text in a retrieval-augmented corpus built from the existing site content.
This approach confines the LLM’s creative latitude to the areas where it adds value: selecting which blocks to show, composing copy for a specific user intent, and organizing page structure. The brand voice, product facts, and visual identity all come from the grounded corpus, not from the model’s parametric memory.
The system architecture separates concerns cleanly. The front end runs on Adobe Experience Manager’s edge delivery services, where content is served from the edge and blocks are composed dynamically. The backend handles LLM evaluation, prompt execution, and the retrieval-augmented generation layer, running across Google and Cloudflare infrastructure with a vector database supporting the RAG pipeline.
The signal layer is where personalization actually happens. The system buckets users into intent categories — distinguishing, for example, between someone exploring options and someone ready to buy — by tracking pages visited and dwell time. All of this context is fed into the LLM as generation input. Sanchez’s demo included a debugging panel that displayed these signals in real time as he browsed the site, making visible the otherwise invisible machinery of intent detection.
Three Personalization Modes, Three Different Latency Budgets
Sanchez describes three distinct personalization paths, each with different technical and economic characteristics.
The first is instant persona adaptation. As a user browses, the site’s blocks shift to match their inferred persona. A visitor who has spent time reading product stories sees different hero content, product recommendations, and navigation than someone who went straight to a product page.
The second is query-driven generation. When a user searches, the results page is generated fresh for that specific query and that specific user. This is the highest-latency path and the one where the 1.1-second benchmark matters most. A search query is inherently synchronous — the user types, the system must respond.
The third is the recommendation page, which Sanchez calls the “For You” page. As signals accumulate during a browsing session, the system generates a recommendation page that can be pre-generated and pre-fetched. This path does not require the same sub-2-second latency because the generation can happen in the background before the user navigates there.
Marketers define personalization strategy in natural language, including how many persona groups to create and how to handle different customer intents. The system then selects blocks and copy for each group. This abstraction layer is critical: the marketing team thinks in terms of audiences and intents, while the system handles the engineering of which blocks to assemble and what text to generate.
Sanchez also flagged that media generation is approaching. He referenced a model announced around the episode date — Nano Banana Light — that could generate images on the fly, though he expressed caution about whether generated images would meet brand-quality standards. Text personalization is proven; image personalization at scale remains an open question.
The “Audience of One” Demo: Three Working Prototypes
Sanchez walked through three live demonstrations, each showing a different surface for the same underlying engine. What made the demos convincing was that they were not slides — they were working systems with visible latency numbers.
The first demo was a coffee machinery commerce site. A browsing session that included visiting product pages and reading editorial stories fed signals that personalized subsequent pages. When Sanchez queried “a coffee machine to prepare coffee while camping,” the system generated a page with customized copy (“Camping shouldn’t mean compromising on your routine”), tailored product recommendations (portable machines), and camping-specific tips.
The second demo introduced OfOneLabs, a tool that generates an agentic site from any URL in under an hour. Sanchez demonstrated this by generating a site for an AI engineering conference, then querying it for “Europe AI conferences” and getting a focused results page. He also showed a side-by-side conference comparison page generated on the fly — a format he highlighted as particularly valuable for decision-oriented queries where users are comparing options.
The third demo was the most forward-looking: voice-activated search on a Google TV. Sanchez described the scenario: a user speaks a purchase-intent query from the living room, and a personalized results page renders on the television screen.
“I’m there in my living room. I don’t need a phone, I don’t need a computer, I don’t need anything, just my voice and something that will kind of show me something that is absolutely personalized to me,” he said.
This demo signals where the technology is heading. The personalized web page is becoming a universal output surface, rendered wherever the user happens to be — phone, computer, television — and driven by intent rather than by navigation.
Evaluation as Continuous Process, Not One-Time Choice
A recurring theme throughout the episode is that model selection is site-specific and must be re-evaluated continuously. Sanchez’s team uses Promptfoo, an open-source evaluation tool, to run automated benchmarks across models and providers. The evaluation harness scored 15 prompts against multiple models and providers for a sample coffee-machinery commerce site, measuring both accuracy and speed.
The trade-off is explicit. Some tasks may not need perfect accuracy but must be fast enough to meet the 1-2 second window. Others may tolerate higher latency for better quality. The optimal model varies by site characteristics — size, domain, commerce type — which is why Sanchez’s team runs continuous evaluation rather than assuming one model fits all.
The evaluation infrastructure also supports manual testing. The demo site includes a control panel where Sanchez can switch models, adjust temperature, and change token limits on the fly to observe behavioral differences. This dual approach — automated benchmarking plus human-in-the-loop inspection — reflects the reality that LLM behavior is not fully predictable from benchmarks alone.
The Unresolved Economics
The episode surfaces an unresolved tension that matters for anyone evaluating the commercial viability of this approach. Every page view that triggers personalization is an LLM call. Every user navigation can generate multiple calls. The query path and the persona-adaptation path are inherently synchronous — the user is waiting, so the generation must happen now.
The recommendation page is the one place where pre-generation is viable. The system can keep updating it as the user browses and pre-fetch it when the user navigates toward it. But the query path cannot be pre-computed.
Sanchez notes that the choice of a small, fast model — Gemma 4 on Cerebras — is partly a cost decision. “You don’t need a huge LLM to do this sort of work.” But he does not provide per-request cost figures, and the episode leaves the unit economics of hyper-personalization at scale unquantified.
This is the critical unknown. The infrastructure is proven. The latency is solved. The architecture is sound. But whether the cost per session for high-traffic commerce sites makes economic sense remains an open question that Sanchez’s team has not yet answered publicly.
What This Means for the AI Infrastructure Race
The episode’s relevance extends beyond Adobe and its customers. The partnership between Adobe, Cerebras, and Google’s Gemma model illustrates how the AI hardware conversation is shifting from training to inference. Cerebras has carved out a niche serving what the industry calls “premium tokens” — high-speed inference at rates of hundreds or thousands of tokens per second. That positioning has made it an alternative to Nvidia’s GPU dominance for latency-sensitive workloads, a market that is growing as more enterprise applications move from batch processing to real-time generation.
The reference materials frame this shift clearly. The custom silicon wave — Cerebras’s CS-4 systems, Google’s continued TPU development with multiple IP suppliers, Waymo’s autonomous vehicle ASIC — reflects a broader recognition that general-purpose GPUs are not always the optimal choice for specialized workloads. Adobe’s choice of Cerebras for real-time site generation is a concrete instance of this trend playing out in production, not just in vendor roadmaps.
The numbers behind the shift are substantial. Goldman Sachs estimates global AI-related investment will surpass $1 trillion in 2026, with inference now accounting for more than 70 percent of AI infrastructure spending according to SEMI executives. That proportion favors specialized inference hardware over general-purpose GPUs.
For Adobe, the strategic implication is that personalization can become a differentiator without requiring the company to own frontier model development. The approach of evaluating small models per site, switching providers as needed, and reserving pre-generation where possible is a pragmatic engineering answer to a fast-moving hardware landscape.
Sanchez’s closing assessment frames the trajectory. “This is now possible. It’s only going to get better from here on. It’s only going to get cheaper, it’s only going to get faster.”
The open questions are ones worth tracking as this moves from demo to production: brand safety at scale, cost per session, and whether generated media will ever meet marketing quality bars. But the central claim of the episode — that real-time, per-user website generation is no longer a research aspiration but a deployable engineering reality — is backed by measured latency numbers and working prototypes, not speculation. The bottleneck has shifted from model capability to inference speed and cost, and the teams that optimize for those constraints first will define what the personalized web becomes.
Source link
Author

- Ytv Market News
- Share-market news writer and analyst with deep experience covering equities, commodities, forex, and cryptocurrencies for readers in the USA, UK, Canada, and Australia. Ytv Market News delivers timely market updates, practical trading insights, and clear explanations of macro and company-level catalysts that move prices. Combines on-the-ground financial reporting with technical analysis, using concise charts and actionable ideas to help investors and traders make smarter decisions.
Latest entries
Stock Market VideosAugust 30, 2026Stocks Churn as Oil Advance Boosts Treasury Yields
UsaAugust 30, 2026PROCTER & GAMBLE Co ($PG) CEO 2025 Pay Revealed
Crypto NewsAugust 30, 2026Ethereum Holders Staked $64 Million to Buy a $75 Blokyz NFT
Investing InsightsAugust 30, 2026Carlos Sanchez: Adobe Builds Websites That Assemble Themselves in 1.1 Seconds — BigGo Finance
