GSC Game World‘s S.T.A.L.K.E.R : Clear Sky – a showcase for Direct3D 10.0/1 Speakers: Igor A. Lobanchikov – Former Lead Gfx Engineer at GSC Holger Gruen - ISV Engineer AMD GPG Agenda Introduction The X-Ray rendering architecture Notable special effects MSAA deferred rendering 10.0/10.1 » G-buffer optimization » Direct3D 10.1 accelerated effects » Q&A » » » » Introduction » Jon Peddie mentions Stalker : Clear Sky as one of his two top games of 08! » JON PEDDIE’S TECH WATCH • Volume 9, NUMBER 1 » The first Direct3D 10.0/1 game to be released with a deferred MSAA renderer » Contains several Direct3D 10.1 rendering paths » » MSAA alpha test, accelerated sunshaft and shadows Direct3D 10.1 used for quick prototyping of the MSSA renderer » This talk walks you through the Direct3D 10.0/1 and other optimizations done in a joint effort between GSC and AMD The X-Ray rendering architecture » Rendering stages – list » G-stage » Light stage » Light combine » Transparent objects » Bloom/exposition » Final combine-2 » Post-effects The X-Ray rendering architecture: stages » G-stage » Output geometry attributes (albedo, specular, position, normal, ambient occlusion, material). » Light stage » Calculate lighting ( diffuse light-RGB, specular light – intensity only) » Interleaved rendering with shadowmap » Draw emissive objects The X-Ray rendering architecture: stages » Light combine » Deferred lighting is applied here » Hemisphere lighting is calculated here (both using OA light-map and SSAO) » Perform tone-mapping here » Output Hi and Lo part of tone-mapped image into 2 RTs The X-Ray rendering architecture: stages » Transparent objects » Basic forward rendering » Bloom/exposition » Use Hi RT as a source for bloom/luminance estimation » Final combine-2 » Apply DOF, distortion, bloom here » Post-effects » Apply black-outs, film-grain, etc.. Dynamic rain » Prepare shadowmap as seen along the direction of rain » Visible pixels are considered wet » Apply postprocess to G-Buffer » Make albedo darker and specular higher » Fix-up normal » That's all Dynamic rain: normal fix-up » Horizontal surfaces » Use tiled volume texture to animate puddle rings » Vertical surfaces » Scroll texture with the water stream vertically » All normals are treated as worldspace ones Dynamic rain: G-buffer modification Dynamic rain disabled Dynamic rain enabled Normal visualization Combined image Dynamic rain: shadowmap » Use shadowmap to mask pixels invisible to the rain » Draw only static geometry » Snap shadowmap texels to world space » Use jittering to hide shadowmap aliasing and simulate wet/dry area border. Dynamic rain: shadowmap 4-tap shadowmap Jittered shadowmap Dynamic rain: what’s next? » Use material ID » Use more directions for gradient detection » Puddle map » Project additional puddle textures on the ground for artist-defined behavior » Use reprojection cache? » Storing rain shadowmap history from the previous frame could allow us to use dynamic objects as rain occluders Sun Shafts » Just do ray-marching » Shadowmap test needs to be carried out on every step » Jitter ray length and use PCF to hide banding artifacts » Use lower single sample intensity to hide noise Sun Shafts performance considerations » High sampling shadowmap coherency due to the high coherency of positions in G-buffer (breaks for A-tested geometry) » Even higher sampling coherency for dueling frustum case » Fixed number of steps eliminates dynamic branching which helps in low coherency edge cases Sun Shafts: Cascaded Shadow Map case » Just use single cascade for the whole ray » Simpler algorithm » Lower resolution shadowmap reduces banding for longer rays » Visible border between cascades Sun Shafts MSAA deferred rendering 10.0/10.1 » Deferred MSAA Rendering under DX10 » Main concept » Stages affected by MSAA rendering » Easy prototyping with Direct3D 10.1 » DX10 A2C MSAA deferred rendering 10.0/10.1 main concept » Render to MSAA G-buffer » Mask edge pixels » Process only subsample #0 for plain pixels. Output to all subsamples » Process each subsample for edge pixels independently MSAA deferred rendering: MSAA output » G-stage (subsample geometry data) » Light stage (subsample lighting) » Light combine (subsample data combination) » Transparent objects » Bloom/exposition » Final combine-2 » Post-effects MSAA deferred rendering: read from MSAA source » G-stage » Light stage (uses G-stage data) » Light combine (uses G-stage and light stage data) » Transparent objects » Bloom/exposition » Final combine-2 » Post-effects MSAA deferred rendering: MSAA in/out stages » For each shader » Plain pixel – run shader at pixel frequency » Edge pixel – run at subpixel frequency » Early stencil hardware minimizes PS overhead MSAA deferred rendering: MSAA in/out stages plain pixel pass Shader edge pixel pass Shader Shader Shader Shader MSAA deferred rendering » DX10.0 doesn‘t support running shader at subsample frequency (DX10.1 does) » Use DX10.1 for fast prototyping » For DX10.0 use separate pass for each subsample: shaders specifies subsample to read at compile time, use output mask to allow writing to a single subsample MSAA deferred rendering: DX10.0 plain pixel pass Shader edge pixel #0 pass edge pixel #2 pass Shader Shader edge pixel #1 pass edge pixel #3 pass Shader Shader MSAA deferred rendering: DX10.0 A2C » Alpha-tested geometry can‘t be MSAA‘d using common technique » Use A2C to approximate anti-aliasing » Alpha-channel of all G-Buffers store geometry attributes: need 2-pass algorithm: » Write only depth using A2C » Write geometry data using Z-equal G-Buffer Optimization - 1 » Stalker originally used a 3-RT G-buffer » 3d Pos + materialID => RGBA16F RT0 » Normal + Ambient occl. => RGBA16F RT1 » Color + Gloss => RGBA8 RT2 » At high resolutions/msaa-settings the size of the G-buffer becomes the bottleneck » Joint effort optimization effort lead to a 2-RT GBuffer » Normal+Depth+matID+AO => RGBA16F RT0 » Color + Gloss => RGBA8 RT1 » Trade packing math vs. less G-Buffer texture ops » Reduces G-Buffer size from 160 to 96 bits per pixel G-Buffer Optimization - 2 » Reconstruct 3D position from depth // input SV_POSITION as pos2d New_pos2d = ( (pos2d.xy) * (2/screenres.xy) )– float2(1,1); viewSpacePos.x = gbuffer_depth * tan( 90-HORZFOV/2 ) * New_pos2d.x; viewSpacePos.y = -gbuffer_depth * tan( 90-VERTFOV/2 ) * New_pos2d.y; viewSpacePos.z = gbuffer_depth; » Normals get un-/packed from 2D <-> 3D Packing Unpacking float2 pack_normal( float3 norm ) float3 unpack_normal(float2 norm) { { float2 res; float3 res; res = 0.5*( norm.xy + float2( 1, 1 ) ) ; res.xy=( 2.0 * abs(norm) ) – float2(1,1); res.x *= ( norm.z<0 ? -1.0 : 1.0 ); res.z =(norm.x < 0? -1.0:1.0) * sqrt(abs(1 – res.x*res.x - res.y*res.y)); return res; return res; } } G-Buffer Optimization - 2 » Pack AO and matID into the usable bits of the last 16bit fp channel of RT0 » Pack data into a 32bit uint as a bit pattern that is a valid 16bit fp number » Cast the uint to float using asfloat() » Cast back for unpacking using asuint() » Extract bits Direct3D 10.1 accelerated effects - Agenda » MSAA Alpha test » A brief recap » Shader based A2C » Why would you want to do this in a shader? » Non-hierarchical min-max shadow maps » Hybrid plane based/min-max solution Direct3D 10.1 accelerated effects – MSAA Alpha Test » Sample texture once for each MSAA sub-sample » » Sample locations standardized in Direct3D 10.1 ddx/ddy used to calculate UV coordinates for sample locations » Set SV_COVERAGE for samples passing the AT » Higher image quality than Direct3D 10.0 A2C! » One rendering pass only in Stalker » A2C needs two passes in Stalker under Direct3D 10.0 » Good for CPU-limited situations » More texture-heavy than Direct3D 10.0 A2C » Especially at high AA settings (e.g. 8xMSAA) Direct3D 10.1 accelerated effects – Shader A2C » Why would you want to do this? » » MSAA Alpha test slower than A2C at high (msaa) settings Control over SV_COVERAGE allows one-pass shader-based A2C in Stalker » » » Direct3D 10.0 A2C needs two passes in Stalker Shader-based A2C only needs to look at one texture sample Admittedly lower quality than MSAA AT but sometimes speed is all you care about Direct3D 10.1 accelerated effects – Shader A2C cont. We tried two methods to implement this Method 1 at 4xMSAA 15 1 2 5 5 2 3 5 5 3 4 5 5 4 5 5 5 0 bits in SV_COVERAGE set 1 bit in SV_COVERAGE set 2 bits in SV_COVERAGE set 3 bits in SV_COVERAGE set 4 bits in SV_COVERAGE set SV_POSITION.x+ SV_POSITION.y used to select bit pattern Direct3D 10.1 accelerated effects – Shader A2C cont. Method 2 at 4xMSAA 15 SV_POSITION.x+ SV_POSITION.y used to perturb alpha 1 2 5 5 2 3 5 5 3 4 5 5 4 5 5 5 SV_COVERAGE = 0 SV_COVERAGE = 1 SV_COVERAGE = 3 SV_COVERAGE = 7 SV_COVERAGE = 15 This method got used in Stalker – it is simply cheaper! Direct3D 10.1 accelerated effects – Shader A2C cont. No obvious difference in IQ expected – only a zoom-in shows a difference Direct3D 10.0 A2C Direct3D 10.1 shader based A2C Direct3D 10.1 accelerated effects – min/max SM Recap » Min-Max Shadows Maps introduced at GDC 05 by K. Dmitriev & Y. Uralsky » Key idea: Build MIP-chain from a shadow map » Store min/max depth of 4 texels in next MIP down » Allows hierarchical rejection of sub-blocks of a shadow filter kernel » Traverse MIPs and check for overlap of shadow filter kernel quad with current min-max SM quad » If center.z >= max Z => full shadow » Else if center.z < min Z => full light » Can accelerate large filter kernels Direct3D 10.1 acc. effects – non-hierarchical min/max SMs » Reduce NxN block of SM texels to one minmax texel MinMax-Z texel Full light minZ expensive test Full shadow maxZ SM texels Direct3D 10.1 acc. effects – non-hierarchical min/max SMs » Can still be used to reject sub-blocks of a shadow filter kernel MinMax-Z texel Full light minZ expensive test Full shadow maxZ SM texels Direct3D 10.1 acc. effects – non-hierarchical min-max SMs » Same test logic as hierachical min-max SMs MinMax-Z texel Full light minZ expensive test Full shadow maxZ SM texels Direct3D 10.1 acc. effects – non-hierarchical min/max SMs » Higher chance for one-sample quick rejection test than hierachical min-max SM MinMax-Z texel Full light minZ expensive test Full shadow maxZ SM texels Direct3D 10.1 acc. effects – min/max SM construction Direct3D 10.1 accelerates min-max SM construction – e.g. for a 4x4 to 1 reduction Direct3D 10.0 NxN (4x4) = 16 point samples if one wants to find min-max depth Direct3D 10.1 w z w z x y x y w z w z x y x y (N/2)x(N/2) = 4 Gather() samples get all data Direct3D 10.1 acc. effects – non-hier. min/max SMs cont. Things to consider when using the min-max SM .. Let’s consider a shadow map And its min-max SM Direct3D 10.1 acc. effects – non-hier. min-max SMs cont. Things to consider when using the min-max SM .. A shadow mapping filter kernel can overlap four min/max SM texels It is necessary to sample all min/max texels that are touched by the kernel Direct3D 10.1 acc. effects – non-hier. min/max SMs cont. Things to consider when using the min/max SM .. Instead one can just have overlapping minmax construction kernels And use only one sample ! Stalker uses an overlapping filter kernel big enough to allow quick rejection of sunshaft shadow map probes and uses Gather() to accelerate min/max SM lookups for big shadow filter kernels Direct3D 10.1 acc. effects – non-hierarchical min/max SMs Ground planes or other big planar features create problems! One texel in the min-max SM » All pixels within the projected area are between minZ/maxZ » All go down the expensive path » Only way around this is a high depth bias with all its problems Direct3D 10.1 acc. effects – non-hier. min/max SMs cont. z z0 » Try to fit a plane through all depth samples in the block to convert to min/max z y x » Store plane equation as RT0:-z0, RT1:(dz/dx,dz/dy) instead of RT0:maxZ, RT1: minZ, 0 ) » Shadow shader uses sub-texel offsets to compute depth D using stored plane equation » This solves the issues with planar features! » Safe to assume that the whole filter kernel is in front of or behind the plane Direct3D 10.1 acc. effects – non-hier. min/max SMs cont. » Why use min-max SMs in Stalker ? » Allows for a higher shadow quality at high FPS » » » Rejects most pixels as fully lit or fully shadowed Expensive 8x8 shadow filter only for pixels that need them Min-Max SMs accelerate sunshaft rendering » » Up to 4 PCF lookups into the shadow map per step per ray Uses min-max SM to skip these lookups if possible Q&A [email protected]