Freelance - Digital Experimentation Manager

Overview

Manager, Digital Experimentation

Reporting to: Senior Manager, Digital Experience & Optimization

ABOUT THE ROLE:

• You are a results-driven digital marketer with a proven track record for optimizing web-based user experiences through comprehensive testing and data-driven methodologies and conveying impact and findings to key business stakeholders.
• Your experience and expertise in A/B testing platforms, conversion rate optimization, user feedback programs, and heatmapping analytics for web will shape
•  Testing strategy and drive continuous performance improvements.
• In this role on the Digital Experience team, you’ll partner with web development, and cross-functional stakeholders to design, execute, and analyze testing programs that deliver measurable business impact as part of the larger Performance Marketing team.
• You’ll own the testing platform strategy, establish best practices, and translate complex, multi-platform performance data into actionable insights.
• By staying at the forefront of CRO, experimentation, and user research methodologies, you’ll ensure Amex GBT leverages best-in-class testing to remain competitive in an increasingly data-driven digital landscape.

WHAT YOU WILL DO:

• A/B Testing Platform & Strategy
• Own the A/B testing platform (Adobe Target) technical set-up, configuration, and documentation library establish and maintain platform governance and access controls.
• Design testing experiment hypotheses in collaboration with team members and stakeholders to leverage site analytics, user behavior data, and user feedback to identify high-impact opportunities.
• Execute and monitor A/B and multi-variant tests to ensure rigorous methodology (Bayesian, Multi-Armed Bandits, etc), consistent data flow, and clear understanding of success metrics.
• Report on A/B testing performance (velocity, lift, statistical significance, business impact) and communicate findings to stakeholders at appropriate levels of details
• Collaborate with technical teams and developers to set up in-depth tracking mechanisms for tests to understand the full context of user experience and isolate variables affecting performance.
• Establish cadence and governance for test documentation, version control, and post-test archival to create institutional knowledge and prevent hypothesis duplication.
• Monitor test configuration and data integrity/validity to ensure reliable experiment results prior to informing business decisions.

User Feedback & Testing Programs

• Own and manage the user feedback and research testing platform(s) (Lyssna, UserTesting, etc.) to gather qualitative insights on user behaviors, motivations, and pain points.
• Design and execute user research studies and feedback programs that inform hypothesis generation, validate testing assumptions, and identify new optimization opportunities.
• Synthesize user feedback with quantitative testing data to triangulate findings and prioritize tests with the highest potential impact.
• Establish a net-new feedback program roadmap aligned with business priorities and testing program velocity.
• Maintain and improve user research documentation and insights library for reference across optimization initiatives.

UX Data & User Behavior Analysis

• Co-own the heatmapping and session recording platform (HotJar, Quantum Metric, Amplitude) to ensure consistent data flow that aligns with GA and other site data sources
• Map user journeys for live sites and test experiences to develop a comprehensive understanding of user pathways, pain points, and opportunities in partnership with Sr Digital Marketing Performance Manager.
• Synthesize heatmap, session recording, and behavioral data into clear narratives for stakeholder presentations; translate findings into testable hypotheses.

Analytics Integration & Data Quality

• Collaborate with the Sr Digital Performance Marketing Manager team to establish seamless data flow from testing platform to GA4, data warehouse, and reporting systems.
• Optimize in-depth tracking and event taxonomy for A/B tests in partnership with Sr Digital Performance
• Marketing Manager and/or agency partners to ensure test data is captured, attributed, and reportable across all downstream analytics platforms.
• Troubleshoot testing-related analytics discrepancies and data integrity issues in partnership with
• Marketing Operations, Development Teams, Web Teams, and other relevant stakeholders.

Stakeholder Communication & Suppor

• Communicate testing program progress, results, and learnings to stakeholders across the organization in clear, accessible formats on a consistent cadence
• Support the Senior Manager, Digital Experience & Optimization with testing portfolio analysis, testing opportunity validation, and prioritization recommendations.
• Partner with cross-functional teams (development, content, product) to ensure testing requirements are clearly understood and implemented correctly.

What you have…

• 3+ years of direct experience in A/B testing and conversion rate optimization (CRO)
• Hands-on expertise with Adobe Target and demonstrated ability to manage platform technical set-up, configuration, and documentation.
• Advanced knowledge of UX data tools including heatmaps, session recording, and journey mapping platforms (HotJar, Quantum Metric, Amplitude, or similar).
• Demonstrated experience with user feedback and testing platforms (Lyssna, UserTesting, Maze, or similar) and ability to design and manage user research programs.
• Strong quantitative analytical skills with the ability to design sound hypotheses, interpret statistical significance, and communicate performance metrics.
• JS/jQuery or CSS familiarity for advanced testing processes
• User-centric mindset with a deep understanding of B2B user behavior and decision-making pathways across the entire user lifecycle.
• Demonstrated proficiency with Google Analytics (GA4), Google Tag Manager, and web analytics best practices; ability to coordinate tracking with development teams.
• Excellent written and verbal communication skills with the ability to translate complex data into clear insights for technical and non-technical audiences.
• Stellar attention to detail and commitment to data quality; an organized approach to documentation, testing governance, and stakeholder management.
• Experience working collaboratively with global teams in different time zones across development, marketing, and product teams to prioritize and execute testing programs aligned with business objectives.

Even better…

• Familiarity with personalization, segmentation, and advanced targeting capabilities.
• Certifications in Google Analytics, CRO, experimentation methodologies, or related fields.
• Experience with statistical analysis, sample size calculation, and multi-variant testing methodologies.
• Experienced with agile methodologies and comfortable in rapidly evolving, cross-functional team environments.
• Proven experience building and scaling testing programs from early stage to mature, high-velocity operations.
• Understanding compliance and ethical standards in digital marketing and user research (GDPR, CCPA, informed consent, etc.).
• Passion for continuous learning and staying current with CRO, experimentation, and user research industry trends, including emerging personalization and segmentation capabilities.
• Multilingual is a plus!