Art of DS

Appearance

Palette
Theme
Unlock $20 one time
Sign in, or create an account

Sign in to Art of DSCreate your Art of DS account

We email you a link and a six-digit code. Either one signs you in; there is no password.Enter your email. We send a link and a six-digit code to confirm it — no password to remember. The account is free.

  • You come back to this page, right where you were.
  • Already have an account? The same email simply signs you in.

By continuing you accept the Terms and the Privacy policy.

Your account

Free accountLifetime access

difficulty 3/5

Receptive field

Definition

The region of the input a single unit can possibly depend on — which grows only linearly with depth, and whose influence is concentrated in a Gaussian centre far smaller than the region itself.

Formula
rℓ=rℓ−1+(kℓ−1)∏i<ℓsir_{\ell} = r_{\ell-1} + (k_{\ell} - 1)\prod_{i<\ell} s_i

Intuition

Pick one number in a deep feature map and ask which input pixels could have changed it. In the first convolutional layer the answer is a 3 × 3 patch. In the second it is 5 × 5, because each of those nine came from a patch of its own. Keep going and the region grows — but only by k − 1 per layer, which is slow.

This matters because a unit cannot recognise something larger than it can see. If the answer depends on an object spanning 200 pixels and the unit's reach is 40, no amount of training fixes it: the information never arrived.

And there is a second, less obvious problem. Not all pixels in that reach matter equally. The ones at the centre are connected to the unit by many paths; the ones at the rim by very few [1, §1]. The region a unit could use and the region it actually uses are different sizes, and the gap widens with depth.

Formal definition

How it works

Where it's used

Worked example

Pitfalls

Check yourself

3 questions

The questions on this page come with access. They are graded on the server, so the answers stay there until you have given yours.

Unlock all quizzes

Sources

  1. Luo, Li, Urtasun, Zemel. Understanding the Effective Receptive Field in Deep Convolutional Neural Networks (2017)paperhttps://arxiv.org/abs/1701.04128
  2. Zhang, Lipton, Li, Smola. Dive into Deep Learningbook · retrieved 2026-09-05https://d2l.ai/

Have a promo code?

A code that takes 100% off unlocks everything at once. A smaller one takes its share off the price in the payment window: enter the same code there.

Write to support

A question, a problem with access, a refund? Write to us and we answer by email.

What is it about?

Your address is used only to answer you.

Message sent

Thank you. We will reply to the address you gave, by email.

Or write to us directly

support@artofds.com

Message sent Thank you. We will reply to the address you gave, by email.

Check the email address: we need it to reply.

That is our own address. Enter yours, so the reply reaches you.

This address cannot receive email. Check it for a typo.

Write a little more: at least 10 characters.

Too many messages in a short time. Try again in a few minutes.

The message could not be sent. Please write to us directly: support@artofds.com