Performance
N+1: one logical operation, many round-trips
A page is slow at 800 ms. The CPU profile looks fine — no wide functions. Sven opens the database query log and counts 51 queries for one page load. The profiler never lied; the bottleneck is not in any single function. It is spread across 51 small round-trips.
What the N+1 problem is
The user requests “show me a list of orders with their customer names.” The ORM executes one query for orders, then one query per order to fetch the customer — 1 + N queries. With 50 orders on the page that is 51 database round-trips for one render.
Each round-trip pays network latency (1–5 ms intra-DC, 10–50 ms cross-region) plus query overhead. A page that should take 20 ms takes 500 ms — and the engineer cannot find the problem in a CPU profile, because the cost is distributed across many fast calls. No single function is slow.
Why ORMs produce N+1 by default
Object-relational mappers expose a model where each object has relationships accessed like plain properties. order.customer reads as if it is a plain attribute; under the hood the ORM triggers a query if the customer is not yet loaded. This is called lazy loading — convenient because you do not declare what you need up front, but it is the source of N+1.
Loop over 50 orders, read order.customer.name on each one, and the ORM fires 50 queries without you writing 50 queries.
The pantry metaphor
Cooking pasta and need garlic, oil, salt, and basil:
- Option A (batch): walk to the pantry once, grab all four, walk back. One trip.
- Option B (N+1): walk for garlic, return; walk for oil, return; walk for salt, return; walk for basil, return. Four trips.
Same work — four trips versus one. The N+1 pattern is option B. The fix is option A: reduce the walks.
The unit of cost here is the round-trip: the time from when your code asks for data to when the data is in your hands. RTT, query parse, planner overhead, lock acquisition, result encoding — all paid per round-trip. One query of 100 rows pays it once; 100 queries pay it 100 times.
A concrete example
// ORM code that looks innocent:
const orders = await Order.findAll({ where: { userId } });
for (const order of orders) {
const customer = await order.getCustomer(); // fires one query per order
render(order, customer);
}
// Query log:
// SELECT * FROM orders WHERE user_id = 42 LIMIT 50 — 1 query
// SELECT * FROM customers WHERE id = 1 — 1 query
// SELECT * FROM customers WHERE id = 2 — 1 query
// ...
// SELECT * FROM customers WHERE id = 50 — 1 query
// Total: 51 queries × ~15 ms RTT = 765 msThe fix in Prisma or most ORMs is one word — include:
const orders = await prisma.order.findMany({
where: { userId },
include: { customer: true },
});
// Now: 2 queries — one for orders, one for all customers via IN (...)
// Total: ~20 ms| Approach | Queries | Time (intra-DC, 15 ms RTT) |
|---|---|---|
| Lazy (N+1) | 51 | ~765 ms |
| Eager / include | 2 | ~30 ms |
Nested N+1: the problem compounds
A dashboard renders teams → projects → members. Naive ORM:
- 1 query for teams
- N queries for projects (one per team)
- N×M queries for members (one per project)
With 10 teams × 5 projects × 8 members: 1 + 10 + 50 = 61 queries. Fix with nested eager loading: 3 queries total. Render time drops from 1.5 s to 80 ms.
Why this works
The N+1 name reflects the worst case: 1 query for the parent collection plus 1 per parent = 1 + N. The term entered mainstream programming around 2003–2005 with the rise of ORMs like Active Record (Rails 2004) and Hibernate (Java). The shape reappears in every new data-access framework: Prisma added include in 2020; every modern ORM ships it.
A page is slow but the CPU profile shows no wide functions. The database query log shows hundreds of small queries. What is the most likely cause?
Why does fetching 100 rows in ONE query beat fetching 100 rows in 100 separate queries?
Order the four common fix patterns for N+1, from simplest to most flexible:
- 1 JOIN — fetch parent and child in one query with a SQL join
- 2 IN (...) — first query gets parent IDs, second fetches all children WHERE child_id IN (parents)
- 3 Eager loading / preload — ORM directive that turns lazy access into one batched query
- 4 Batch loader (DataLoader) — collect all child IDs across the request, fire one batched query when the event loop yields
Fill in the blank: an N+1 query pattern is N+1 _______ — each one fast on its own, but the total of all the trips is what makes the page slow.
- 01In one paragraph: explain why the N+1 problem is hard to find with a CPU profile and where to look instead.
- 02What is lazy loading and why does it produce N+1 by default?
The N+1 problem turns one logical operation into 1 + N database round-trips by loading each related row lazily. With 50 items, that is 51 queries; at 15 ms RTT each, the page takes 765 ms instead of 30 ms. The root cause is lazy loading — the ORM default that fires a query each time a related property is accessed. The fix is structural: use an eager-load directive (Rails .includes, Django .select_related, SQLAlchemy selectinload, Prisma include) to tell the ORM what you need up front. A CPU profile will not show you this bottleneck; the query log will.
appears again in159
- The journey of a request: seven stops from socket to responsejunior
- Accept and parse: from kernel queue to a typed requestmiddle
- Routing and middleware: choosing what runs, and in what ordermiddle
- Handler and response: from business logic to bytes on the wiremiddle
- Streaming and backpressure: when the client reads slower than you writesenior
- Timeouts and tail latency: budgets, deadlines, and the fan-out trapsenior
- Middleware and DI: the two patterns that shape every backendjunior
- Writing middleware: signatures, next(), and the three framework modelsmiddle
- Inversion of control: how dependencies reach a classmiddle
- DI scopes and lifecycles: singleton, request, transientmiddle
- DI as a testing seam: fakes, mocks, and the boundary that matterssenior
- DI containers in production: resolution graphs, circular deps, and when not tosenior
- Blocking vs non-blocking I/O: two ways to waitjunior
- The event loop: one thread, ordered phasesmiddle
- What blocks the loop: CPU work and sync callsmiddle
- Offloading CPU work: worker threads and the libuv poolmiddle
- Backpressure and bounded concurrencysenior
- Throughput under load: tail latency and saturationsenior
- Why pool: the cost of creating a connectionjunior
- Pool sizing: why bigger is not fastermiddle
- Acquisition and timeouts: the wait queue is the real latency dialmiddle
- Retry strategies: backoff, jitter, and thundering herdmiddle
- Observability, production failures, and global-scale designsenior
- Tasks, microtasks, and scheduler.yield()middle
- Timer accuracy, throttling, and idle workmiddle
- Node.js event loop: phases, nextTick, and loop lagsenior
- Rendering strategies: SSG, SSR, ISR, streaming, and hydrationjunior
- SSG, SSR, ISR, streaming, and RSC — how each worksmiddle
- Hydration cost: selective, progressive, islands, resumabilitymiddle
- Core Web Vitals: what LCP, INP, and CLS measurejunior
- LCP: four phases, one dominant costmiddle
- INP: input delay, processing, presentationmiddle
- Lab vs field: why the two disagree and how to use eachmiddle
- Metric tradeoffs, RUM attribution, and the CI+field loopsenior
- The full picture: URL to LCP to INP as a relay racejunior
- Eight layers traced: from the service worker to the second navigationmiddle
- Five canonical breaks: where production reliably diessenior
- The three-track method: reading traces and building a monitored systemsenior
- What an index is and how it speeds up queriesjunior
- The leading-column rule and composite index designmiddle
- Partial, expression, and covering indexesmiddle
- Index types: GIN, GiST, BRIN, Hash, Bloom, and HOT updatesmiddle
- Index-only scans, the Visibility Map, and INCLUDEsenior
- Production failure modes and the index audit playbooksenior
- Index design exercise: full-text search strategysenior
- EXPLAIN and execution plans: what the planner decides and whyjunior
- Scan types: Seq, Index, Bitmap, Index-Onlymiddle
- Join algorithms and the row-estimate cascademiddle
- pg_statistic, ANALYZE, and production observabilitymiddle
- Extended statistics: fixing correlated-column estimate failuressenior
- Plan cache, cost-constant tuning, and planner internalssenior
- Production failure modes and plan stabilitysenior
- Connection pools: amortising the cost of a Postgres backendjunior
- PgBouncer session, transaction, and statement modesmiddle
- Pool sizing: the (cores × 2) + spindles formula and the two-layer stackmiddle
- Pool exhaustion and idle-in-transaction: the 3 AM failure modemiddle
- Migrating to transaction mode: rollout playbook and PgBouncer 1.21 prepared statementsmiddle
- The Postgres process model and why raising max_connections degrades throughputsenior
- Pooler landscape 2026, serverless connection storms, and the full failure-mode taxonomysenior
- ADD COLUMN: instant in PG 11+ vs rewrite in older Postgresjunior
- The lock-queue failure mode: why instant DDL can freeze the databasemiddle
- Safe DDL patterns: NOT VALID, CONCURRENTLY, and unsafe-op fixesmiddle
- Migration failure taxonomy and production disciplinesenior
- Shard-key selection: hash, range, list, and directory strategiesmiddle
- Co-location and Citus: the invariant that makes sharding usablemiddle
- The hot-shard failure mode: detection, isolation, and durable policymiddle
- Online resharding, 2PC, and the operational cost of shardingsenior
- The seven acts: from CREATE TABLE to Citusjunior
- Acts 1–3 in depth: schema, indexes, and planner statisticsmiddle
- Acts 4–6 in depth: MVCC bloat, connection pooling, and safe migrationsmiddle
- Act 7 in depth: sharding, co-location, and the seven-tier tradeoff cascademiddle
- Observability, anti-patterns, and production triagesenior
- Bits on the wirejunior
- Latency mathmiddle
- Bufferbloat and congestionsenior
- The physical frontiersenior
- Sequence numbers and connection statemiddle
- Flow control and congestion controlmiddle
- BBR, production observability, and beyond TCPsenior
- CDN: putting content next doorjunior
- Anycast and GeoDNS: routing to the nearest edgemiddle
- Tiered cache and Cache-Controlmiddle
- Vary header and cache keysmiddle
- Stale-while-revalidate and cache stampedesenior
- Edge workers and edge-side compositionsenior
- CDN operations and observabilitysenior
- WebSocket: the HTTP upgrade handshakejunior
- WebSocket vs SSE vs long-polling: choosing the right transportmiddle
- WebSocket backpressure: when clients can''''t keep upmiddle
- Reconnection: jittered backoff, thundering herd, message resumptionsenior
- WebSocket at scale: HTTP/2 multiplexing, permessage-deflate, C10Msenior
- WebSocket in production: proxies, security, and distributed architecturesenior
- What reverse proxies dojunior
- Balancing algorithms: round-robin to power-of-two-choicesmiddle
- L4 vs L7 load balancing and client-IP preservationmiddle
- Health checks, connection draining, and slow startmiddle
- Retry storms, circuit breakers, and load sheddingsenior
- Resilient LB architecture: anycast, zone-aware routing, and observabilitysenior
- Why QUIC and not TCP+TLSjunior
- QUIC streams and head-of-line blockingjunior
- Integrated handshake and 1-RTTmiddle
- Connection IDs and network migrationmiddle
- Loss detection and congestion controlmiddle
- 0-RTT resumption and packet encryptionsenior
- Deployment tradeoffs and CPU costsenior
- DDoS: what it is and why it worksjunior
- Amplification attacks and state exhaustionmiddle
- Rate limiting: algorithms and architecturemiddle
- WAFs, firewalls, mTLS, and HSTSmiddle
- DNS cache poisoning and BGP hijackingsenior
- Defense-in-depth architecture and attack economicssenior
- The twelve layers: one URL, seven actorsjunior
- DNS, TCP, TLS in sequence: where the milliseconds gomiddle
- Critical render path and Core Web Vitalsmiddle
- Proxy intercepts and security gates: rate limiters, WAF, mTLSmiddle
- Alternate paths: QUIC 0-RTT, WebSocket upgrade, connection migrationmiddle
- Observability: distributed traces, USE/RED, and samplingsenior
- Resilience: cascading retries, circuit breakers, and error budgetssenior
- What the three signals are: logs, metrics, and tracesjunior
- Metrics and cardinality: the cost model of a time-series databasemiddle
- Logs and volume: the cost model of structured loggingmiddle
- Traces and sampling: the cost model of distributed tracingmiddle
- Join keys and exemplars: making the three signals composemiddle
- Observability 2.0: wide events and the cost shiftsenior
- Failure modes and engineering practice: cardinality budgets, PII, and samplingsenior
- Why structured logs exist: the diary vs the spreadsheetjunior
- The production log schema: fields every line must carrymiddle
- Log levels and alert routingmiddle
- Sampling strategies and log costmiddle
- PII redaction and log injectionsenior
- Trace context propagation in logssenior
- OTel Logs Data Model and audit logs as a subsystemsenior
- OTel signals, Semantic Conventions, and the OTLP wire formatmiddle
- Auto-instrumentation and manual spans: the 80/20 of OTelmiddle
- The OTel Collector: receivers, processors, exporters, and deployment patternsmiddle
- Sampling strategies: head, tail, and parent-basedmiddle
- Vendor neutrality, eBPF instrumentation, the Operator, and browser/serverless OTelsenior
- Operating the OTel Collector: reliability, version skew, failure modes, and governancesenior
- RED and USE: two checklists, one triage disciplinejunior
- Instrumenting RED in Prometheus: counters, histograms, and cardinality disciplinemiddle
- USE on Linux: CPU, memory, disk, network, and PSImiddle
- Golden signals, dashboard layout, and service mesh auto-REDmiddle
- Cardinality as a cost driver: labels, PII, exemplars, and samplingmiddle
- Native histograms, SLO tie-in, and production failure patternsmiddle
- Choosing SLIs and SLO targets: ratios, not feelingsmiddle
- Multi-window multi-burn-rate alerting: why AND beats ORmiddle
- Error budget policy, latency SLOs, and composite journeysmiddle
- Iceberg SLIs, composite SLO math, and SLA vs SLOsenior
- Flame graphs: reading the picture that shows where time goesjunior
- Sampling vs instrumentation profiling: why 99 Hz wins in productionmiddle
- Profile types: CPU, memory, off-CPU, mutex — which one to reach formiddle
- Continuous profiling: always-on flame graphs with eBPF and trace-id correlationmiddle
- How flame graphs are built from samples, and the production workflows that use themmiddle
- Linux perf, eBPF internals, PGO, and the limits of samplingsenior
- Profiling in production: security, war stories, OTel profiles, and the infrastructure designsenior
- The debugging funnel: SLO → RED → trace → profilejunior
- OTel architecture: one SDK, four signals, one wire formatmiddle
- Cost discipline: keeping observability under 5% of infra spendmiddle
- Scale, security, and the ROI of observable systemssenior