Job Title: Product Manager - A/B Testing Location: San Francisco, CA Duration: Long-term Rate : $50 to $55/hr on W2
Job Description Product Manager - A/B Testing. Summary: The Product Manager, A/B Testing, will conceptualize, design, and deliver digital A/B testing strategies designed to improve site performance and the relevancy of our on-site experience to customers. This person will define both the long-term roadmap and manage day to day strategy and execution of our A/B testing efforts with significant opportunities to drive positive KPI growth. Responsibilities:
Lead the definition, prioritization and scoping of test experiences for engineering team
Craft business requirements and user stories and to support our testing engineering teams through solution design, development, QA, and implementation phases of delivery
Ensure each test idea has a business opportunity driven by data, a clear audience definition, measurable KPIs, an execution plan, and stakeholder buy in
Work with your Product Analytics partner to define KPIs and metrics for tests, monitor test performance, and review postmortem results & recommendations
Drive action based on test results that align with the business goals, including development of future test ideas
Identify testing opportunities using test results analysis and other touchpoints (UX studies, analytics reporting, market and industry trends, competitor product analysis. etc.)
Collaborate with brand partners to ideate on testing opportunities to maintain a full pipeline of experiments for engineering
Create and execute test campaigns using Adobe Target and homegrown A/B testing solution, including audience creation, enlisting IT development resources for more complicated functional test treatments
Work with the rest of the Product Analytics & Experimentation team to foster a culture of data-driven decision making across e-commerce that encourages validating or disproving assumptions about how we believe customers may react to various site experience scenarios
Requirements
5+ years of Product Management experience in technology organizations, with some of that time focused on experimentation - you identify as a product person
Self-starter who can ramp up quickly and thrive in a fast-paced environment
Strong attention to detail and organizational skills to manage multiple projects at once
Excellent communication skills and ability to work with all levels of end users and technical resources harmoniously
Comfortable presenting program strategy and results to senior management
You have a point-of-view about how technology teams should engage to iteratively deliver value for the customer (ideally with Lean or Agile principles)
Relevant experience working with at least one testing tool (Adobe Target, Optimizely, or similar)
Strong analytical abilities and interest to use data and metrics to back up recommendations and drive actions
Baseline understanding of statistical concepts in A/B test analysis: Understanding Statistical significance, confidence intervals, and Sample Size requirements are a must when working with Product Analytics partners to understand tests results
High energy and results oriented with a passion for the role - looking to drive improvements and change
Retail e-Commerce experience preferred
Ability to work effectively with teams in a collaborative, cross-functional environment
Highly organized with a strong attention to detail and the ability to meet deadlines
Excellent written and verbal communication skills, with the ability to present data insights clearly to various stakeholders