Virtual Production as the Starting Point for Complex TVC Scenes

When TVCs involve complex scenes, traditional methods include physical sets, location coordination, or post-production CG replacement. Virtual production shifts set construction from physical to digital space, yet the project initiation phase is most prone to misunderstanding. Brands often assume virtual production can fully replace live action, while production teams may overestimate its technical capabilities. The true starting point is defining which shots require live action, which can be digitally generated, and which need a hybrid approach. The criterion is whether physical interaction affects performance; for example, actors touching props, interacting with liquids, or responding to wind require retained live-action elements. Virtual production suits environmental backgrounds, hazardous zones, historical sites, or inaccessible locations. During initiation, prepare a scene breakdown listing each shot's live-action components, digital elements, interaction points, lighting conditions, and camera movement. Brands must provide core selling points and visual references so the team can assess if virtual production truly reduces risk or cost. If the scene is inherently simple, virtual production may increase timelines and budgets, making it unsuitable.

TVC footage from case materials, observing the relationship between camera, subject, and lighting
Case study frame from the research material 'Indiana Jones and the Destroyed Miniatures.' This image illustrates cinematography and production methods only and does not represent an ONCE client project. Source page Case Study Page

Breaking Down Shooting Units and Virtual Production Integration Points for Complex Scenes

Complex scenes typically comprise multiple shooting units, such as interior close-ups, exterior wide shots, dynamic camera moves, and VFX shots. Virtual production interventions focus on specific units. The approach involves grading storyboards by live-action difficulty: Level 1 is standard live action; Level 2 combines live action with minor digital extensions; Level 3 involves extensive digital environments or hazardous stunts. Virtual production primarily supports Levels 2 and 3. After breaking down shooting units, the required fidelity for each virtual scene must be defined, applying different precision levels to backdrops, foreground occlusions, and interactive props. The production team must verify that the virtual scene's perspective, focal length, and motion paths match the live-action footage to ensure seamless post-production compositing. Brands should provide reference imagery and mood boards to help the virtual art team establish a visual direction. A key risk is lighting mismatch between virtual and live-action elements, causing inconsistencies in shadow direction, color temperature, or reflections. The solution is conducting lighting pre-visualization before shooting, using simple geometry to simulate virtual lighting before adjusting live-action lights. An exception occurs when camera movement is extremely fast or depth of field is very shallow; in these cases, virtual background detail requirements decrease, saving rendering resources.

Six Essential Deliverables from Brands During Pre-Production

Virtual production pre-production relies more heavily on complete documentation than traditional filming. Brands must deliver six categories of materials. First, communication objectives and audience profiles specifying ad platforms and viewing contexts, which determine the virtual scene's visual style and detail density. Second, core selling points and product feature lists, as virtual production must highlight product characteristics like automotive interior reflections or food textures. Third, reference imagery and competitor case studies covering camera movement, color grading, atmosphere, and pacing. Fourth, shooting conditions detailing available time windows, location restrictions, talent availability, and weather risks. Fifth, delivery platform and version requirements, noting that different platforms have varying resolution, frame rate, and color space specifications, requiring flexibility in master outputs. Sixth, copyright clearances for architecture, artwork, character likenesses, or brand elements used in virtual scenes. Upon receipt, the production team must verify all items and address gaps before the PPM meeting. If brands cannot provide references, storyboard sketches or concept art may substitute upon written confirmation. Incomplete documentation can lead to virtual scene rework, directly impacting delivery schedules.

Collaboration Workflow and Real-Time Feedback During Virtual Production Shoots

During execution, the virtual production, camera, lighting, and directing teams must collaborate in real time. Standard workflow includes completing virtual scene pre-rendering and tracking calibration before shooting, monitoring composited feeds during takes, and reviewing keyframes immediately afterward. Real-time feedback is a core advantage of virtual production, allowing directors to view composite images of digital backgrounds and live actors on set to adjust performances or camera moves instantly. However, since real-time preview resolution and lighting accuracy are lower than final renders, brands must understand that on-set visuals differ from final output. Every take must log virtual scene version numbers, tracking data, lighting parameters, and camera movements to enable accurate post-production replication. Lighting crews must pay special attention to virtual light source directions, using adjustable-color-temperature LEDs to match digital environments. Camera operators should avoid excessive movement speeds that cause tracking loss, reducing speed or adding markers if necessary. Reflective or transparent surfaces in live-action footage may capture on-set equipment, requiring separate post-processing. When actors interact with virtual objects, such as touching screens, physical stand-in props must be placed during filming for later replacement. Immediately after wrapping, the team must back up all data, including raw footage, tracking files, and virtual scene projects.

Post-Production Compositing and Precise Virtual Scene Matching

The core post-production task is precisely compositing live-action footage with virtual scenes. Step one is color matching, unifying color temperature, contrast, and saturation between virtual and live elements using color management tools and LUT conversions. Step two is geometric matching, verifying that perspective, scale, and lens distortion align, adjusting virtual camera parameters if needed. Step three is lighting matching, analyzing shadow direction, highlight placement, and reflection details in live footage to supplement or adjust virtual lighting. Step four is interaction matching, handling occlusion, contact points, and motion blur between live and virtual objects. While post teams use professional compositing software, brands need only focus on acceptance criteria rather than specific tools. Acceptance reviews should examine every shot, prioritizing edge blending, noise consistency, depth-of-field transitions, and motion blur. If live footage contains motion blur, matching blur must be added to virtual scenes to prevent unnatural composites. Insufficient virtual detail may reveal flaws in close-ups; solutions include enhanced texture mapping or higher-fidelity models. Post-production must also account for rendering time, as complex scenes require extended processing; brands should confirm whether delivery schedules include render cycles. For rapid revisions, teams should provide low-resolution previews for approval before delivering final versions.

Acceptance Checklists and Version Management Protocols

Acceptance focuses on stage-by-stage documentation. Brands should establish checklists covering at least the following: script and storyboard alignment to ensure all creative points are addressed; visual quality regarding resolution, frame rate, color, and noise; audio quality including dialogue, SFX, music, and mixing; subtitle accuracy for content, positioning, and timecodes; version completeness across platforms, durations, and languages; master specifications confirming format compliance; and source file delivery including project files, raw footage, virtual assets, and grading LUTs. Each item requires a designated reviewer and confirmation timestamp. Version control must follow naming conventions, such as date plus version number, to prevent overwriting previous versions. During review, note that digital elements may contain hidden defects like edge flickering or tracking jitter requiring magnified inspection. If defects arise, the team must identify whether they stem from rendering, tracking, or compositing and propose fixes. Brands should maintain written feedback throughout acceptance, with the team responding to each point. Modifications involving virtual scene reconstruction require schedule impact assessments. Subjective aesthetic differences regarding specific shots constitute creative adjustments rather than technical defects, but revision limits and associated costs must be contractually defined.

Scenarios Unsuitable for Virtual Production and Alternative Solutions

Virtual production is not a universal solution and is unsuitable in the following cases. First, for extremely simple, cost-sensitive scenes like solid-color studio shoots, traditional green screen or live-action sets are more economical. Second, when authentic physical interaction is required and cannot be simulated by stunt doubles—such as actors interacting with large volumes of liquid, fire, or dust—virtual production struggles to replicate realistic physical feedback. Third, if the brand demands absolute realism and cannot accept any digital artifacts, such as in faithful reproductions of historic buildings or natural landscapes, traditional filming combined with post-production restoration is more reliable. Fourth, on projects with extremely tight schedules, virtual production pre-rendering and calibration may take longer than traditional shooting. Fifth, when the team lacks virtual production experience and sufficient risk management capabilities. In these situations, alternatives include traditional green screen compositing, practical set builds with digital extensions, or full CG production. Brands should evaluate project goals and available resources rather than adopting technology for its own sake. If virtual production is selected but certain scenes are unsuitable, a hybrid approach can be used, such as combining live-action close-ups with virtual backgrounds. Production teams must define applicable boundaries during the proposal phase to avoid late-stage changes. Brands should also understand that the value of virtual production lies in managing risks for complex scenes, not replacing all filming methods.

Next Steps and Prudent Pre-Launch Assessment

When preparing a TVC project, virtual production should be considered one solution for complex scenes rather than the default option. Brands are advised to first assess scene complexity and identify shots with practical risks, cost issues, or schedule constraints. Then conduct technical rehearsals with the production team, using simple tests to validate virtual production results and timelines. Rehearsals cost less than principal photography and effectively reduce decision-making risks. Proceed to formal project approval only if rehearsal results are satisfactory. Define acceptance criteria and revision limits at approval to avoid later disputes. Also review platform publishing requirements based on the latest official specifications. Virtual production requires close collaboration among the brand, production team, and technology vendors; responsibilities and delivery milestones should be clearly defined in the contract. Finally, do not overlook the value of traditional production, as many complex scenes can be solved through clever practical design. Maintain an open mind and choose the approach best suited to project goals rather than chasing trends. If virtual production is truly needed, start preparations early and allow sufficient time for environment development and testing.

If you are preparing a TVC project, gather your brief, reference imagery, product or company materials, delivery platforms, and licensing scope before reviewingthe TVC Services pageto translate abstract preferences into actionable production parameters.