0
\$\begingroup\$

Both methods involve casting a ray unto the reflecting object. It will be reflected. In reflection mapping - the intersection of this reflected ray with the environment map (texture) will yield the result.

Isn't it the same for ray-tracing, though? Or is ray-tracing classified only as ray-tracing if it works with the real 3D geometry in the scene (not pre-computed images).

\$\endgroup\$

2 Answers 2

2
\$\begingroup\$

Up until recently, when someone said raytracing, they almost certainly meant rendering the whole scene with ray-based techniques. Meaning...

  1. For each pixel in the image, we fire a ray from the camera through that point in the image plane

  2. We search the scene for where this ray intersects an object, and render a surface there

  3. We calculate the colour of the pixel using the material of the struck surface point, modulated by information from additional rays, such as...

    • Rays aimed at light sources to detect intersections with occluding objects, to determine illumination / shadow
    • Rays reflected from the hit point to detect intersections with other scene objects and compute their colours to draw specular / mirror-like reflection of other parts of the scene viewed through this surface
    • Rays scattered from the hit point to detect intersections with other scene objects and compute their colours to gather diffuse bounced light (global illumination)


    Each of these rays can independently searching our whole scene for new intersections, and evaluate material colours the same way, firing subsequent rays of their own... repeating this rendering process down to some maximum recursion depth, so we get extremely accurate calculation of the light bouncing around the scene even between many unrelated surfaces.

This is in contrast to techniques like reflection mapping, shadow mapping, parallax occlusion mapping, etc, which are tricks we can use to add additional detail and effects to scenes rendered with rasterization. In rasterization, we flip the problem: rather than each image pixel searching for the geometry in the scene under it, we take each piece of geometry and compute which pixels it covers:

  1. For each vertex in the scene, we project it into image space

  2. For each triangle, we compute the image pixels/fragments that fall between these transformed vertices in our image plane

  3. For each of these pixels/fragments, we compute the colour by running a shader program that generally has limited information about only the immediate context of this operation.

    This is super fast on GPUs, and has historically outperformed raytracing for rendering large complex scenes in realtime. But it has a downside: the information we have at the rasterization/shading stage is usually fairly local to the triangle/fragment we're drawing.

    We typically don't have the ability to search the whole scene for arbitrary ray-geometry intersections - so we use approximations. These usually involve looking up some data from a pre-computed texture "map" of the relevant values, which is why you'll often find "mapping" in the names of these techniques.

    • Instead of casting a ray toward the light and looking for intersecting occluders, we use a shadow map computed in advance or earlier in the frame to decide whether we're in shadow.

    • Instead of drawing specular reflection by intersecting a reflected ray with the scene and computing the colour of that scene point recursively, we look up a particular pixel from a reflection map (again, either precomputed & baked or updated earlier this frame) to approximate what's probably in roughly that direction.

      Although we're computing a reflected ray here, we're not really "tracing" that ray through our scene to find intersections in the same way that a raytracing renderer does. We're just using some similar math to compute a lookup coordinate.

      That said, in some cases we can use raymarching with our depth buffer to get more raytracing-like results.

I say "until recently" because new graphics cards are starting to introduce more options for hybridizing raytracing and rasterization techniques. So now on some GPUs and in some circumstances, you can issue ray-geometry intersection searches from pixels of rasterized geometry. It's still costly and needs to be carefully budgeted, but you may find these techniques starting to complement or even displace many of the approximations we've traditionally used in rasterization.

\$\endgroup\$
2
  • \$\begingroup\$ Thank you, this is such a great and well-written answer. Anything new to add in 2022, now that RTX cards are commonplace? \$\endgroup\$
    – thule
    Commented Nov 23, 2022 at 18:59
  • \$\begingroup\$ I'd still class this as an emerging area, so for now I don't have any more to add than the "until recently" paragraph at the bottom. \$\endgroup\$
    – DMGregory
    Commented Nov 23, 2022 at 19:02
0
\$\begingroup\$

Ray-tracing generally refers to techniques that perform repeated ray-casts with the reflections of a ray through a scene. Changes in the scene will always be present in reflections generated by ray-tracing.

Reflection mapping is effectively the ray tracing method with two optimizations:

  • Only one reflection is performed.
  • The result is retrieved from an environment map.

Since the environment maps are pre-generated, they do not respond to changes in the scene and this is where reflection mapping majorly differs from ray-tracing.

It is technically possible to retrieve the result from the next surface the ray hits in the scene. If this technique is used it would be considered ray-tracing and still capture some changes in the scene.

\$\endgroup\$
0

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .