Manager, Media Experimentation

Job description

Company Description

NBCUniversal is one of the world’s leading media and entertainment companies. We create world-class content, which we distribute across our portfolio of film, television, and streaming, and bring to life through our global theme park destinations, consumer products, and experiences. We own and operate leading entertainment and news brands, including NBC, NBC News, NBC Sports, Telemundo, NBC Local Stations, Bravo, and Peacock, our premium ad-supported streaming service. We produce and distribute premier filmed entertainment and programming through our powerhouse film and television studios, including Universal Pictures, DreamWorks Animation, and Focus Features, and the four global television studios under the Universal Studio Group banner, and operate industry-leading theme parks and experiences around the world through Universal Destinations & Experiences, including Universal Orlando Resort, home to Universal Epic Universe, and Universal Studios Hollywood. NBCUniversal is a subsidiary of Comcast Corporation. Visit www.nbcuniversal.com for more information.

Our impact is rooted in improving the communities where our employees, customers, and audiences live and work. We have a rich tradition of giving back and ensuring our employees have the opportunity to serve their communities. We champion an inclusive culture and strive to attract and develop a talented workforce to create and deliver a wide range of content reflecting our world.

Job Description

The Manager, Media Experimentation leads NBCU’s incrementality testing program for Performance and Device media in partnership with the Sr. Manager of Media Experimentation. The ideal candidate is the methods & QA owner: you will shape the learning agenda, enforce power standards, ensure study designs are decision-grade, and translate vendor results into clear budget guidance—reconciled with Marketing Mix Modeling (MMM) and Multi-Touch Attribution (MTA) so leaders can act with confidence and speed. This person will be a key cross-functional leader with the Performance and Device Media teams, helping to inform crucial company decisions on marketing investment and allocation.

Key responsibilities could include, but are not limited to:

• Co-own the experimentation roadmap with the Sr. Manager of Media Experimentation; define learning agenda, decision questions, hypotheses, success metrics, guardrails, and power thresholds; review/approve vendor designs and reject under-powered or invalid proposals.
• Lead day-to-day relationship with external measurement vendor— partner with Sr. Manager to prioritize the study backlog, deliver accurate data, align on methods, track SLAs and change logs, escalate blockers
• Collaborate with Sr. Manager of Media Experimentation on ensuring clear schedules, accurate data inputs, agency and/or vendor alignment, and structured documentation of results
• Partner with the vendor and a Media Analytics analyst to produce clear, defensible readouts that inform decisions (lift, uncertainty, risks); write concise decision memos and hand off to Optimization and & Insights team for execution and pacing/optimization.
• Drive calibration with MMM/MTA; propose tiebreakers and thresholds for decisioning; contribute to cross-channel measurement efforts by triangulating learnings.
• Ensure high quality of analysis with speed; Monitor design defects/leakage; run targeted validations (SQL/R/Python spot checks) as needed; improve run-rate without sacrificing validity.
• Mentor a Media Analytics analyst; uplevel partner teams (brief quality, power, common pitfalls); collaborate with data science and other analytics & media teams; contribute to a standardized measurement approach across the NBCU Media Group.

Qualifications

• 4+ years in marketing/media experimentation with direct design/QA ownership and experience partnering with an incrementality testing measurement vendor (e.g., Haus, Measured, or similar).
• Proven command of causal inference in media—appropriate use of RCT, geo, diff-in-diff, and platform holdouts—and the ability to evaluate vendor assumptions/methods.
• Familiarity with power analysis, and failure modes (leakage, seasonality, parallel trends); history of stopping or redesigning under-powered tests.
• Platform experience: Google/Meta/TikTok incrementality and at least one CTV/Device environment (e.g., Roku, Samsung, Vizio).
• Experience reconciling vendor experiment reads with MMM/MTA and informing planning/pacing decisions without surprises.
• Fluent in SQL and Excel
• Knowledge of big data infrastructure and data science techniques.
• Effective communicator and collaborator with strong project management; ability to work in a highly matrixed environment and influence media buyers/channel leads.

Desired Characteristics:

• Strong interpersonal skills with the ability to collaborate, motivate, and influence.
• Ability to thrive in a fast-paced environment and meet tight deadlines.
• Proficient in using R or Python for data analysis
• Strong interest in the media industry, specifically in television and streaming.
• Strong sense of accountability, curiosity, and an innovative mindset, with the ability to thrive in a fast-paced, evolving environment.

Additional Requirements:

• Hybrid: This position has been designated as hybrid, which currently requires contributing from the office a minimum of three days per week. Beginning January 5, 2026, hybrid employees will be required to work from the office a minimum of four days per week. The Company reserves the right to change in-office requirements at any time.
• This position is eligible for company sponsored benefits, including medical, dental and vision insurance, 401(k), paid leave, tuition reimbursement, and a variety of other discounts and perks. Learn more about the benefits offered by NBCUniversal by visiting the Benefits page of the Careers website. Salary range: $100,000 - $160,000 (bonus & long-term incentive eligible).

Additional Information

As part of our selection process, external candidates may be required to attend an in-person interview with an NBCUniversal employee at one of our locations prior to a hiring decision. NBCUniversal’s policy is to provide equal employment opportunities to all applicants and employees without regard to race, color, religion, creed, gender, gender identity or expression, age, national origin or ancestry, citizenship, disability, sexual orientation, marital status, pregnancy, veteran status, membership in the uniformed services, genetic information, or any other basis protected by applicable law.

If you are a qualified individual with a disability or a disabled veteran and require support throughout the application and/or recruitment process as a result of your disability, you have the right to request a reasonable accommodation. You can submit your request to [email protected].