TOPS measures compute, and LLM decode is bandwidth-bound, not compute-bound — see our [NPU vs GPU breakdown](/blog/npu-vs-gpu-local-llm-2026/). The numbers that matter are 102.4 and 153.6 GB/s, which sit between a Mac Mini M4 Pro (273 GB/s) and a smartphone.

Oct 25, 2026

Tiiny AI Pocket Lab in 2026: The $1,399 80GB Pocket AI Box vs Hardware You Can Buy Today

By RunAIHome Team · 12 min read

mini-pcnpuai-hardwarelocal-llmbuying-guide

TL;DR: The Tiiny AI Pocket Lab raised $3.07M on Kickstarter promising gpt-oss-120b in a 300g, $1,399 box. Its own spec sheet shows 15 tok/s at 4K context, the “80GB” is two separate memory pools, and three months past the August delivery estimate we found no confirmed shipped unit. Buy hardware that exists.

	Tiiny AI Pocket Lab	GMKtec EVO-X2 128GB	Used RTX 3090
Best for	80GB-class memory in your pocket — someday	Big MoE models (gpt-oss-120b) today	Fastest tok/s per dollar under 24GB
Price	$1,299–$1,399 preorder, unshipped	~$3,499	~$1,456–$1,558
The catch	Split 32+48GB pools, vendor’s own 15 tok/s number, Kickstarter risk	256 GB/s caps dense-model speed	24GB ceiling, no 100B+ MoE residence

Honest take: A preorder is not a product. The EVO-X2 128GB does the Pocket Lab’s headline job — gpt-oss-120b, fully resident, offline — at a measured 31–56 tok/s, and it ships this week. If $3,499 is too much, a used RTX 3090 covers everything through 32B for $1,456–$1,558 and demolishes the Pocket Lab’s numbers on every model that fits in 24GB.

The Tiiny AI Pocket Lab is the most-funded local AI gadget of 2026: a palm-sized box that claims to run 120-billion-parameter models completely offline. It went viral on Hacker News, picked up a Guinness certification, and collected $3,069,202 from 2,181 backers between March 11 and April 10, 2026. The pitch lands because it targets a real pain point — unified-memory machines that can hold big MoE models start around $2,199 and run to five figures.

The pitch also doesn’t survive the bandwidth math this site applies to every box that crosses its desk. Here is what the Pocket Lab actually is, what its own published numbers say, and what the same money buys from hardware you can order today and return if it disappoints.

What the Pocket Lab actually is

Despite the “pocket supercomputer” branding, the Pocket Lab is not a standalone PC. It is a USB-attached inference appliance: a 300g box running TiinyOS (a Linux-based stack with SSH and Docker access for developers) that your Windows or Mac laptop talks to through a client app. Models run entirely on the device — your laptop’s RAM and GPU are not involved.

The published specs, from Tiiny’s technical-details page and Notebookcheck’s coverage:

Component	Spec
CPU	12-core Armv9.2 SoC with ~30 INT8 TOPS integrated NPU
Accelerator	Discrete “dNPU,” ~160 INT8 TOPS (≈190 TOPS combined)
Memory	80GB LPDDR5X-6400 — 32GB on the SoC + 48GB on the dNPU
Bandwidth	102.4 GB/s (SoC pool) + 153.6 GB/s (dNPU pool)
Storage	1TB PCIe 4.0 SSD
Power	~30W TDP, 65W USB-C adapter
Weight	~300g
Price	$1,399 Kickstarter early bird; $9.90 deposit now locks $1,299

Two things on that sheet deserve more attention than the TOPS number that leads every press release.

First, nobody has named the chip vendors. “12-core Armv9.2 SoC” and “dNPU” describe a category, not a part. Level1Techs and Hacker News commenters have pressed on this since March without an answer, and one independent analysis — bay41’s reverse-engineering piece, bluntly titled “Here’s Why Your $1,400 Is Probably Gone” — argues the renders and marketing photos don’t resolve to any known silicon combination at this price.

Second, and more important for anyone who reads this site: the 80GB is not one pool.

80GB that behaves like 48GB + 32GB

Decode speed on every local LLM box is capped by memory bandwidth, not compute. The ceiling formula we use on every hardware review:

tok/s ceiling = memory bandwidth (GB/s) ÷ weights read per token (GB)

gpt-oss-120b (MoE, ~5B active params, MXFP4): ~2.5–3 GB read per token

Tiiny dNPU pool:   153.6 GB/s ÷ 3 GB ≈ 51 tok/s ceiling
Tiiny both pools:  256 GB/s   ÷ 3 GB ≈ 85 tok/s ceiling (vendor's best case)
Strix Halo:        256 GB/s   ÷ 3 GB ≈ 85 tok/s ceiling (measured: 31–56)
RTX 3090:          936 GB/s — but 24GB can't hold the ~61GB model at all

Real hardware lands at 40–70% of ceiling. So even if Tiiny’s “parallel access to both pools” claim works perfectly — which would make it, in aggregate, exactly a Strix Halo — the honest expectation for gpt-oss-120b is 30–55 tok/s.

Here is the problem a careful buyer hits immediately: Tiiny’s own published benchmarks disagree with each other. One spec block on tiinyai.com lists gpt-oss-120b (mixed INT4/INT8) at 15 tok/s decode at 4K context, 5.7 tok/s at 64K, and 3.8 tok/s at 128K. A different block on the same site claims 33.8 tok/s at 4K and 22.9 at 64K. The marketing headline says “18–40 tokens/second average output.” The CES 2026 demo was reported by audioXpress as “20+ tok/s.” And bay41’s screenshot of a vendor demo showed 16.85 tok/s at 256-token context — the easiest possible setting.

The fix for this, as a reader, is the ceiling formula above: work out what the bandwidth physically allows, then ask why the vendor’s numbers scatter from 3.8 to 40. The scatter has a likely physical explanation. The gpt-oss-120b weights are ~61GB — about 65GB resident with KV cache. That does not fit in the 48GB dNPU pool. Roughly 17GB of weights must live in the 32GB SoC pool, and every token has to pull expert weights across whatever link joins the two chips. Run the formula backwards on the vendor’s 15 tok/s figure and you get an effective bandwidth of ~45 GB/s — less than a third of the dNPU pool’s rating, which is what crossing a chip-to-chip link does. The 33.8 tok/s block is only plausible if the test cherry-picked expert routing that stayed on the dNPU. A single-pool machine has no such split: ServeTheHome measured ~31 tok/s on a 128GB Strix Halo, every run, no asterisk — see our Strix Halo 64GB vs 128GB breakdown.

For smaller models the picture inverts in an unflattering way. Anything that fits in 24GB — Qwen3.6-27B, gpt-oss-20b, every model in our 24GB tier guide — runs 4–6× faster on a used RTX 3090’s 936 GB/s than on either Tiiny pool. The Pocket Lab’s only theoretical win is the 27B-to-80B band, and that band is exactly where the pool split hurts most.

Funded in March, due in August, unverified in October

The Kickstarter campaign closed April 10, 2026 at $3,069,202 from 2,181 backers, against a $10,000 goal. Estimated delivery: August 2026.

As of this writing (October 25, 2026), we could not find a single confirmed backer delivery, unboxing, or independent benchmark of a production unit. BackerGuardian’s trust report — last updated July 27 — noted no confirmed shipments and no third-party benchmarks. Nothing newer surfaced in our searches: no reviews from named outlets, no r/LocalLLaMA owner threads, no llama.cpp-style community numbers. The only hands-on content remains the March CES-circuit demos, where the device was operated by Tiiny staff. Notebookcheck’s assessment of the 120B claim: “far-fetched,” wait for third-party reviews.

That is not proof of failure — hardware crowdfunding runs late far more often than it collapses. But the structure of the deal matters. Kickstarter is not a store: there is no delivery guarantee and no refund mechanism once funds are collected. The current $9.90 deposit path on tiiny.ai locks a $1,299 price for a device with no verified ship date. You are not buying a computer; you are buying a position in a queue of 2,181 people who also haven’t received one, for hardware whose two published benchmark tables disagree with each other by 2×.

Our take on when preordering unreleased AI hardware makes sense hasn’t changed since the DGX Spark pricing saga: never pay today’s money for tomorrow’s bandwidth unless you can afford to treat it as a donation.

What the same money buys today

If the 80GB memory class is the point — you want gpt-oss-120b-class MoE models resident and offline — the GMKtec EVO-X2 is the machine the Pocket Lab is impersonating. The 128GB Ryzen AI Max+ 395 configuration runs $3,499–$3,649 street (verified October 2026), holds the ~65GB resident footprint of gpt-oss-120b in one flat 256 GB/s pool, and delivers a measured 31–56 tok/s on it. That is $2,100 more than the Pocket Lab’s preorder price — and it exists, with return windows and a year of community ROCm/Vulkan tuning behind it. The 64GB version at $2,199 is closer to Tiiny money but, like the Pocket Lab’s 48GB fast pool, it cannot hold gpt-oss-120b; it tops out around the 35B-A3B class.

If you’d actually run 7B–32B models — which is what most home labs run daily — a used RTX 3090 at $1,456–$1,558 is the same money as the Pocket Lab and roughly 5× the effective speed. 936 GB/s moves gpt-oss-20b at ~161 tok/s and Qwen3.6-class 27B models at 40+ tok/s; the full breakdown is in our $3K/$6K/$10K build guide and the evergreen used 3090 value-king piece. Yes, it needs a PC around it and draws 10× the wattage. It also answers prompts today.

If the appeal was genuinely the size and silence, a Mac Mini M4 Pro at $1,399 is the honest small-quiet-box pick: 273 GB/s of single-pool bandwidth — more than either Tiiny pool alone — in a shipping product that runs ~50 tok/s on 7B Q4 models at 30–40W. Its 24GB base config caps model size hard; our Mac Mini M4 Pro review covers exactly where that ceiling sits.

And if what you really want is to find out whether you’d use a 120B model at all before committing four figures in any direction, rent first: a cloud RTX 3090 starts around $0.07/hr on Vast.ai, and an afternoon of testing costs less than lunch. Check your target model against your hardware with the VRAM calculator before any of these purchases.

What to actually buy

Prices as of October 2026, all verified in the comparison above:

Your situation	The machine	Price	Where
You want gpt-oss-120b resident and offline, today	GMKtec EVO-X2 128GB	~$3,499	Check price
You run 7B–32B models daily and want speed per dollar	Used RTX 3090 24GB	~$1,456–$1,558	Check price
You want a small, silent box on the desk now	Mac Mini M4 Pro	~$1,399	Check price
You’re curious whether 120B-class models fit your workflow	Rented GPU, from ~$0.07/hr	pay per hour	Vast.ai
You believe in the Pocket Lab anyway	Wait for shipped units + independent benchmarks	$0 today	tiiny.ai (no purchase link — it hasn’t shipped)

The row that isn’t there: preordering. If production units ship and someone independent publishes llama.cpp numbers that beat the split-pool math above, this page gets updated and the Pocket Lab earns a real row. Until then, the $9.90 deposit’s only honest function is reserving the right to decide later — which you also have for free.

FAQ

Has the Tiiny AI Pocket Lab shipped? Not that we can verify. Estimated delivery was August 2026; as of October 25, 2026 there are no confirmed backer deliveries, no independent reviews of production units, and no community benchmarks. The last trust-tracker update (July 27) reported zero confirmed shipments.

Can it really run 120B models? The 80GB total is physically enough for gpt-oss-120b’s ~65GB resident footprint, and the CES demos apparently ran it. The issue is speed and honesty of the claim: the memory is split 32GB + 48GB across two chips, the model can’t fit in either pool alone, and Tiiny’s own published decode numbers for it range from 3.8 to 33.8 tok/s depending on which page you read.

Is 190 TOPS good? TOPS measures compute, and LLM decode is bandwidth-bound, not compute-bound — see our NPU vs GPU breakdown. The numbers that matter are 102.4 and 153.6 GB/s, which sit between a Mac Mini M4 Pro (273 GB/s) and a smartphone.

What’s the closest real product? A Ryzen AI Max+ 395 (Strix Halo) mini-PC: same ~256 GB/s bandwidth class as Tiiny’s best-case aggregate claim, one flat pool, shipping since spring 2026. The EVO-X2 128GB is the configuration that actually does the 120B job.

Isn’t $1,399 for 80GB a bargain versus $3,499 for 128GB? Only if it ships, performs at the top of its own conflicting numbers, and holds together as a one-generation USB appliance from a new vendor. You’re not comparing two prices; you’re comparing a price against a probability. For a local coding stack you can point at any of these boxes, our sister site’s Continue.dev + Ollama setup guide works identically on all of them, and aifoss.dev’s Ollama review covers the serving layer.

Sources

Last updated October 25, 2026. Prices and specs change; verify current rates before purchasing. Crowdfunding carries risk of partial or total loss — Kickstarter pledges are not purchases.

Recommended Gear

GMKtec EVO-X2 128GB — the shipping machine that runs gpt-oss-120b resident, ~$3,499
Used RTX 3090 24GB — fastest tok/s per dollar for 7B–32B models, ~$1,456–$1,558
Mac Mini M4 Pro — the real small-silent-box option, $1,399

Was this article helpful?

Get the numbers before you buy

New GPU and mini-PC benchmarks, VRAM thresholds, and price checks — sent when there's something worth acting on, not on a schedule. No spam, unsubscribe anytime.