CINXE.COM

A/B Testing Significance Calculator. Free. Supports AOV and ARPV.

<!DOCTYPE html><html lang="en"><head><link rel="stylesheet" data-href="https://fonts.googleapis.com/css?family=Roboto:300,400,500,700&amp;display=swap"/><link rel="stylesheet" href="https://fonts.googleapis.com/icon?family=Material+Icons"/><link rel="stylesheet" href="https://cdn.jsdelivr.net/npm/katex@0.12.0/dist/katex.min.css" integrity="sha384-AfEj0r4/OFrOo5t7NnNe46zW/tFgW6x/bCJG8FqQCEo3+Aro6EYUG4+cU+KJWu/X" crossorigin="anonymous"/><script async="" src="https://www.googletagmanager.com/gtag/js?id=UA-27764542-1"></script><script> window.dataLayer = window.dataLayer || []; function gtag() { dataLayer.push(arguments); } gtag('js', new Date()); gtag('config', 'UA-27764542-1', { 'anonymize_ip': true, 'linker': { 'domains': ['www.convertexperiments.com'], 'accept_incoming': true } }); (function(w, d, s, l, i) { w[l] = w[l] || []; w[l].push({ 'gtm.start': new Date().getTime(), event: 'gtm.js' }); var f = d.getElementsByTagName(s)[0], j = d.createElement(s), dl = l != 'dataLayer' ? '&l=' + l : ''; j.async = true; j.src = 'https://www.googletagmanager.com/gtm.js?id=' + i + dl; f.parentNode.insertBefore(j, f); })(window, document, 'script', 'dataLayer', 'GTM-N62PSB2'); _linkedin_partner_id = "43322"; window._linkedin_data_partner_ids = window._linkedin_data_partner_ids || []; window._linkedin_data_partner_ids.push(_linkedin_partner_id); (function() { var s = document.getElementsByTagName("script")[0]; var b = document.createElement("script"); b.type = "text/javascript"; b.async = true; b.src = "https://snap.licdn.com/li.lms-analytics/insight.min.js"; s.parentNode.insertBefore(b, s); })(); (function(h, o, t, j, a, r) { h.hj = h.hj || function() { (h.hj.q = h.hj.q || []).push(arguments) }; h._hjSettings = { hjid: 13819, hjsv: 6 }; a = o.getElementsByTagName("head")[0]; r = o.createElement("script"); r.async = 1; r.src = t + h._hjSettings.hjid + j + h._hjSettings.hjsv; a.appendChild(r); })(window, document, "https://static.hotjar.com/c/hotjar-", ".js?sv="); </script><meta charSet="utf-8"/><meta name="viewport" content="minimum-scale=1, initial-scale=1, width=device-width"/><title>A/B Testing Significance Calculator. Free. Supports AOV and ARPV.</title><meta name="robots" content="index,follow"/><meta name="googlebot" content="index,follow"/><meta name="description" content="Looking for an A/B testing significance calculator to calculate AOV and ARPV? Need a check to not peek at test results? Plan with Convert’s calculator."/><meta name="twitter:card" content="summary_large_image"/><meta name="twitter:site" content="@convert"/><meta name="twitter:creator" content="@convert"/><meta property="og:title" content="A/B Testing Significance Calculator. Free. Supports AOV and ARPV."/><meta property="og:description" content="Looking for an A/B testing significance calculator to calculate AOV and ARPV? Need a check to not peek at test results? Plan with Convert’s calculator."/><meta property="og:url" content="https://www.convert.com/calculator/"/><meta property="og:image" content="https://www.convert.com/calculator/convert-ab-test-calculator.png"/><meta property="og:image:alt" content="A/B Testing Significance Calculator. Free. Supports AOV and ARPV."/><meta property="og:image:width" content="1200"/><meta property="og:image:height" content="627"/><meta property="og:site_name" content="A/B Testing Significance Calculator. Free. Supports AOV and ARPV."/><link rel="canonical" href="https://www.convert.com/calculator/"/><meta name="next-head-count" content="18"/><noscript data-n-css=""></noscript><link rel="preload" href="/calculator/_next/static/chunks/webpack-39e6b70f465eea5e349d.js" as="script"/><link rel="preload" href="/calculator/_next/static/chunks/framework.2f5e5c03f8dc9a7f3140.js" as="script"/><link rel="preload" href="/calculator/_next/static/chunks/commons.9e018df1d824d805e587.js" as="script"/><link rel="preload" href="/calculator/_next/static/chunks/main-a5f081a83375a3ade490.js" as="script"/><link rel="preload" href="/calculator/_next/static/chunks/51579cad02b770b54ecfac8b5b5991cee3b69909.4e814b495c768b93cf4e.js" as="script"/><link rel="preload" href="/calculator/_next/static/chunks/pages/_app-4319b8bf28080422a675.js" as="script"/><link rel="preload" href="/calculator/_next/static/chunks/29107295.7761e7b5e54036b65dd8.js" as="script"/><link rel="preload" href="/calculator/_next/static/chunks/96a36b26aee9caa5ec60e479e7458ec3246bf7fd.7263dd9f2b4d6476d4d5.js" as="script"/><link rel="preload" href="/calculator/_next/static/chunks/pages/index-70252ecb0625a75363d3.js" as="script"/><style id="jss-server-side">html { box-sizing: border-box; -webkit-font-smoothing: antialiased; -moz-osx-font-smoothing: grayscale; } *, *::before, *::after { box-sizing: inherit; } strong, b { font-weight: 700; } body { color: rgba(0, 0, 0, 0.87); margin: 0; font-size: 0.875rem; font-family: "Roboto", "Helvetica", "Arial", sans-serif; font-weight: 400; line-height: 1.43; letter-spacing: 0.01071em; background-color: #fafafa; } @media print { body { background-color: #fff; } } body::backdrop { background-color: #fafafa; } .MuiSvgIcon-root { fill: currentColor; width: 1em; height: 1em; display: inline-block; font-size: 1.5rem; transition: fill 200ms cubic-bezier(0.4, 0, 0.2, 1) 0ms; flex-shrink: 0; user-select: none; } .MuiSvgIcon-colorPrimary { color: #2a3442; } .MuiSvgIcon-colorSecondary { color: #DD275B; } .MuiSvgIcon-colorAction { color: rgba(0, 0, 0, 0.54); } .MuiSvgIcon-colorError { color: #f44336; } .MuiSvgIcon-colorDisabled { color: rgba(0, 0, 0, 0.26); } .MuiSvgIcon-fontSizeInherit { font-size: inherit; } .MuiSvgIcon-fontSizeSmall { font-size: 1.25rem; } .MuiSvgIcon-fontSizeLarge { font-size: 2.1875rem; } .MuiCollapse-root { height: 0; overflow: hidden; transition: height 300ms cubic-bezier(0.4, 0, 0.2, 1) 0ms; } .MuiCollapse-entered { height: auto; overflow: visible; } .MuiCollapse-hidden { visibility: hidden; } .MuiCollapse-wrapper { display: flex; } .MuiCollapse-wrapperInner { width: 100%; } .MuiPaper-root { color: rgba(0, 0, 0, 0.87); transition: box-shadow 300ms cubic-bezier(0.4, 0, 0.2, 1) 0ms; background-color: #fff; } .MuiPaper-rounded { border-radius: 4px; } .MuiPaper-outlined { border: 1px solid rgba(0, 0, 0, 0.12); } .MuiPaper-elevation0 { box-shadow: none; } .MuiPaper-elevation1 { box-shadow: 0px 2px 1px -1px rgba(0,0,0,0.2),0px 1px 1px 0px rgba(0,0,0,0.14),0px 1px 3px 0px rgba(0,0,0,0.12); } .MuiPaper-elevation2 { box-shadow: 0px 3px 1px -2px rgba(0,0,0,0.2),0px 2px 2px 0px rgba(0,0,0,0.14),0px 1px 5px 0px rgba(0,0,0,0.12); } .MuiPaper-elevation3 { box-shadow: 0px 3px 3px -2px rgba(0,0,0,0.2),0px 3px 4px 0px rgba(0,0,0,0.14),0px 1px 8px 0px rgba(0,0,0,0.12); } .MuiPaper-elevation4 { box-shadow: 0px 2px 4px -1px rgba(0,0,0,0.2),0px 4px 5px 0px rgba(0,0,0,0.14),0px 1px 10px 0px rgba(0,0,0,0.12); } .MuiPaper-elevation5 { box-shadow: 0px 3px 5px -1px rgba(0,0,0,0.2),0px 5px 8px 0px rgba(0,0,0,0.14),0px 1px 14px 0px rgba(0,0,0,0.12); } .MuiPaper-elevation6 { box-shadow: 0px 3px 5px -1px rgba(0,0,0,0.2),0px 6px 10px 0px rgba(0,0,0,0.14),0px 1px 18px 0px rgba(0,0,0,0.12); } .MuiPaper-elevation7 { box-shadow: 0px 4px 5px -2px rgba(0,0,0,0.2),0px 7px 10px 1px rgba(0,0,0,0.14),0px 2px 16px 1px rgba(0,0,0,0.12); } .MuiPaper-elevation8 { box-shadow: 0px 5px 5px -3px rgba(0,0,0,0.2),0px 8px 10px 1px rgba(0,0,0,0.14),0px 3px 14px 2px rgba(0,0,0,0.12); } .MuiPaper-elevation9 { box-shadow: 0px 5px 6px -3px rgba(0,0,0,0.2),0px 9px 12px 1px rgba(0,0,0,0.14),0px 3px 16px 2px rgba(0,0,0,0.12); } .MuiPaper-elevation10 { box-shadow: 0px 6px 6px -3px rgba(0,0,0,0.2),0px 10px 14px 1px rgba(0,0,0,0.14),0px 4px 18px 3px rgba(0,0,0,0.12); } .MuiPaper-elevation11 { box-shadow: 0px 6px 7px -4px rgba(0,0,0,0.2),0px 11px 15px 1px rgba(0,0,0,0.14),0px 4px 20px 3px rgba(0,0,0,0.12); } .MuiPaper-elevation12 { box-shadow: 0px 7px 8px -4px rgba(0,0,0,0.2),0px 12px 17px 2px rgba(0,0,0,0.14),0px 5px 22px 4px rgba(0,0,0,0.12); } .MuiPaper-elevation13 { box-shadow: 0px 7px 8px -4px rgba(0,0,0,0.2),0px 13px 19px 2px rgba(0,0,0,0.14),0px 5px 24px 4px rgba(0,0,0,0.12); } .MuiPaper-elevation14 { box-shadow: 0px 7px 9px -4px rgba(0,0,0,0.2),0px 14px 21px 2px rgba(0,0,0,0.14),0px 5px 26px 4px rgba(0,0,0,0.12); } .MuiPaper-elevation15 { box-shadow: 0px 8px 9px -5px rgba(0,0,0,0.2),0px 15px 22px 2px rgba(0,0,0,0.14),0px 6px 28px 5px rgba(0,0,0,0.12); } .MuiPaper-elevation16 { box-shadow: 0px 8px 10px -5px rgba(0,0,0,0.2),0px 16px 24px 2px rgba(0,0,0,0.14),0px 6px 30px 5px rgba(0,0,0,0.12); } .MuiPaper-elevation17 { box-shadow: 0px 8px 11px -5px rgba(0,0,0,0.2),0px 17px 26px 2px rgba(0,0,0,0.14),0px 6px 32px 5px rgba(0,0,0,0.12); } .MuiPaper-elevation18 { box-shadow: 0px 9px 11px -5px rgba(0,0,0,0.2),0px 18px 28px 2px rgba(0,0,0,0.14),0px 7px 34px 6px rgba(0,0,0,0.12); } .MuiPaper-elevation19 { box-shadow: 0px 9px 12px -6px rgba(0,0,0,0.2),0px 19px 29px 2px rgba(0,0,0,0.14),0px 7px 36px 6px rgba(0,0,0,0.12); } .MuiPaper-elevation20 { box-shadow: 0px 10px 13px -6px rgba(0,0,0,0.2),0px 20px 31px 3px rgba(0,0,0,0.14),0px 8px 38px 7px rgba(0,0,0,0.12); } .MuiPaper-elevation21 { box-shadow: 0px 10px 13px -6px rgba(0,0,0,0.2),0px 21px 33px 3px rgba(0,0,0,0.14),0px 8px 40px 7px rgba(0,0,0,0.12); } .MuiPaper-elevation22 { box-shadow: 0px 10px 14px -6px rgba(0,0,0,0.2),0px 22px 35px 3px rgba(0,0,0,0.14),0px 8px 42px 7px rgba(0,0,0,0.12); } .MuiPaper-elevation23 { box-shadow: 0px 11px 14px -7px rgba(0,0,0,0.2),0px 23px 36px 3px rgba(0,0,0,0.14),0px 9px 44px 8px rgba(0,0,0,0.12); } .MuiPaper-elevation24 { box-shadow: 0px 11px 15px -7px rgba(0,0,0,0.2),0px 24px 38px 3px rgba(0,0,0,0.14),0px 9px 46px 8px rgba(0,0,0,0.12); } .MuiAccordion-root { position: relative; transition: margin 150ms cubic-bezier(0.4, 0, 0.2, 1) 0ms; } .MuiAccordion-root:before { top: -1px; left: 0; right: 0; height: 1px; content: ""; opacity: 1; position: absolute; transition: opacity 150ms cubic-bezier(0.4, 0, 0.2, 1) 0ms,background-color 150ms cubic-bezier(0.4, 0, 0.2, 1) 0ms; background-color: rgba(0, 0, 0, 0.12); } .MuiAccordion-root.Mui-expanded { margin: 16px 0; } .MuiAccordion-root.Mui-disabled { background-color: rgba(0, 0, 0, 0.12); } .MuiAccordion-root.Mui-expanded + .MuiAccordion-root:before { display: none; } .MuiAccordion-root.Mui-expanded:first-child { margin-top: 0; } .MuiAccordion-root.Mui-expanded:last-child { margin-bottom: 0; } .MuiAccordion-root.Mui-expanded:before { opacity: 0; } .MuiAccordion-root:first-child:before { display: none; } .MuiAccordion-rounded { border-radius: 0; } .MuiAccordion-rounded:first-child { border-top-left-radius: 4px; border-top-right-radius: 4px; } .MuiAccordion-rounded:last-child { border-bottom-left-radius: 4px; border-bottom-right-radius: 4px; } @supports (-ms-ime-align: auto) { .MuiAccordion-rounded:last-child { border-bottom-left-radius: 0; border-bottom-right-radius: 0; } } .MuiAccordionDetails-root { display: flex; padding: 8px 16px 16px; } .MuiButtonBase-root { color: inherit; border: 0; cursor: pointer; margin: 0; display: inline-flex; outline: 0; padding: 0; position: relative; align-items: center; user-select: none; border-radius: 0; vertical-align: middle; -moz-appearance: none; justify-content: center; text-decoration: none; background-color: transparent; -webkit-appearance: none; -webkit-tap-highlight-color: transparent; } .MuiButtonBase-root::-moz-focus-inner { border-style: none; } .MuiButtonBase-root.Mui-disabled { cursor: default; pointer-events: none; } @media print { .MuiButtonBase-root { color-adjust: exact; } } .MuiIconButton-root { flex: 0 0 auto; color: rgba(0, 0, 0, 0.54); padding: 12px; overflow: visible; font-size: 1.5rem; text-align: center; transition: background-color 150ms cubic-bezier(0.4, 0, 0.2, 1) 0ms; border-radius: 50%; } .MuiIconButton-root:hover { background-color: rgba(0, 0, 0, 0.04); } .MuiIconButton-root.Mui-disabled { color: rgba(0, 0, 0, 0.26); background-color: transparent; } @media (hover: none) { .MuiIconButton-root:hover { background-color: transparent; } } .MuiIconButton-edgeStart { margin-left: -12px; } .MuiIconButton-sizeSmall.MuiIconButton-edgeStart { margin-left: -3px; } .MuiIconButton-edgeEnd { margin-right: -12px; } .MuiIconButton-sizeSmall.MuiIconButton-edgeEnd { margin-right: -3px; } .MuiIconButton-colorInherit { color: inherit; } .MuiIconButton-colorPrimary { color: #2a3442; } .MuiIconButton-colorPrimary:hover { background-color: rgba(42, 52, 66, 0.04); } @media (hover: none) { .MuiIconButton-colorPrimary:hover { background-color: transparent; } } .MuiIconButton-colorSecondary { color: #DD275B; } .MuiIconButton-colorSecondary:hover { background-color: rgba(221, 39, 91, 0.04); } @media (hover: none) { .MuiIconButton-colorSecondary:hover { background-color: transparent; } } .MuiIconButton-sizeSmall { padding: 3px; font-size: 1.125rem; } .MuiIconButton-label { width: 100%; display: flex; align-items: inherit; justify-content: inherit; } .MuiAccordionSummary-root { display: flex; padding: 0px 16px; min-height: 48px; transition: min-height 150ms cubic-bezier(0.4, 0, 0.2, 1) 0ms,background-color 150ms cubic-bezier(0.4, 0, 0.2, 1) 0ms; } .MuiAccordionSummary-root:hover:not(.Mui-disabled) { cursor: pointer; } .MuiAccordionSummary-root.Mui-expanded { min-height: 64px; } .MuiAccordionSummary-root.Mui-focused, .MuiAccordionSummary-root.Mui-focusVisible { background-color: rgba(0, 0, 0, 0.12); } .MuiAccordionSummary-root.Mui-disabled { opacity: 0.38; } .MuiAccordionSummary-content { margin: 12px 0; display: flex; flex-grow: 1; transition: margin 150ms cubic-bezier(0.4, 0, 0.2, 1) 0ms; } .MuiAccordionSummary-content.Mui-expanded { margin: 20px 0; } .MuiAccordionSummary-expandIcon { transform: rotate(0deg); transition: transform 150ms cubic-bezier(0.4, 0, 0.2, 1) 0ms; } .MuiAccordionSummary-expandIcon:hover { background-color: transparent; } .MuiAccordionSummary-expandIcon.Mui-expanded { transform: rotate(180deg); } .MuiAppBar-root { width: 100%; display: flex; z-index: 1100; box-sizing: border-box; flex-shrink: 0; flex-direction: column; } .MuiAppBar-positionFixed { top: 0; left: auto; right: 0; position: fixed; } @media print { .MuiAppBar-positionFixed { position: absolute; } } .MuiAppBar-positionAbsolute { top: 0; left: auto; right: 0; position: absolute; } .MuiAppBar-positionSticky { top: 0; left: auto; right: 0; position: sticky; } .MuiAppBar-positionStatic { position: static; } .MuiAppBar-positionRelative { position: relative; } .MuiAppBar-colorDefault { color: rgba(0, 0, 0, 0.87); background-color: #f5f5f5; } .MuiAppBar-colorPrimary { color: #ffffff; background-color: #2a3442; } .MuiAppBar-colorSecondary { color: #ffffff; background-color: #DD275B; } .MuiAppBar-colorInherit { color: inherit; } .MuiAppBar-colorTransparent { color: inherit; background-color: transparent; } .jss9 { } .jss66 { } .jss70 { } .MuiTypography-root { margin: 0; } .MuiTypography-body2 { font-size: 0.875rem; font-family: "Roboto", "Helvetica", "Arial", sans-serif; font-weight: 400; line-height: 1.43; letter-spacing: 0.01071em; } .MuiTypography-body1 { font-size: 1rem; font-family: "Roboto", "Helvetica", "Arial", sans-serif; font-weight: 400; line-height: 1.5; letter-spacing: 0.00938em; } .MuiTypography-caption { font-size: 0.75rem; font-family: "Roboto", "Helvetica", "Arial", sans-serif; font-weight: 400; line-height: 1.66; letter-spacing: 0.03333em; } .MuiTypography-button { font-size: 0.875rem; font-family: "Roboto", "Helvetica", "Arial", sans-serif; font-weight: 500; line-height: 1.75; letter-spacing: 0.02857em; text-transform: uppercase; } .MuiTypography-h1 { font-size: 6rem; font-family: "Roboto", "Helvetica", "Arial", sans-serif; font-weight: 300; line-height: 1.167; letter-spacing: -0.01562em; } .MuiTypography-h2 { font-size: 3.75rem; font-family: "Roboto", "Helvetica", "Arial", sans-serif; font-weight: 300; line-height: 1.2; letter-spacing: -0.00833em; } .MuiTypography-h3 { font-size: 3rem; font-family: "Roboto", "Helvetica", "Arial", sans-serif; font-weight: 400; line-height: 1.167; letter-spacing: 0em; } .MuiTypography-h4 { font-size: 2.125rem; font-family: "Roboto", "Helvetica", "Arial", sans-serif; font-weight: 400; line-height: 1.235; letter-spacing: 0.00735em; } .MuiTypography-h5 { font-size: 1.5rem; font-family: "Roboto", "Helvetica", "Arial", sans-serif; font-weight: 400; line-height: 1.334; letter-spacing: 0em; } .MuiTypography-h6 { font-size: 1.25rem; font-family: "Roboto", "Helvetica", "Arial", sans-serif; font-weight: 500; line-height: 1.6; letter-spacing: 0.0075em; } .MuiTypography-subtitle1 { font-size: 1rem; font-family: "Roboto", "Helvetica", "Arial", sans-serif; font-weight: 400; line-height: 1.75; letter-spacing: 0.00938em; } .MuiTypography-subtitle2 { font-size: 0.875rem; font-family: "Roboto", "Helvetica", "Arial", sans-serif; font-weight: 500; line-height: 1.57; letter-spacing: 0.00714em; } .MuiTypography-overline { font-size: 0.75rem; font-family: "Roboto", "Helvetica", "Arial", sans-serif; font-weight: 400; line-height: 2.66; letter-spacing: 0.08333em; text-transform: uppercase; } .MuiTypography-srOnly { width: 1px; height: 1px; overflow: hidden; position: absolute; } .MuiTypography-alignLeft { text-align: left; } .MuiTypography-alignCenter { text-align: center; } .MuiTypography-alignRight { text-align: right; } .MuiTypography-alignJustify { text-align: justify; } .MuiTypography-noWrap { overflow: hidden; white-space: nowrap; text-overflow: ellipsis; } .MuiTypography-gutterBottom { margin-bottom: 0.35em; } .MuiTypography-paragraph { margin-bottom: 16px; } .MuiTypography-colorInherit { color: inherit; } .MuiTypography-colorPrimary { color: #2a3442; } .MuiTypography-colorSecondary { color: #DD275B; } .MuiTypography-colorTextPrimary { color: rgba(0, 0, 0, 0.87); } .MuiTypography-colorTextSecondary { color: rgba(0, 0, 0, 0.54); } .MuiTypography-colorError { color: #f44336; } .MuiTypography-displayInline { display: inline; } .MuiTypography-displayBlock { display: block; } .MuiButton-root { color: rgba(0, 0, 0, 0.87); padding: 6px 16px; font-size: 0.875rem; min-width: 64px; box-sizing: border-box; transition: background-color 250ms cubic-bezier(0.4, 0, 0.2, 1) 0ms,box-shadow 250ms cubic-bezier(0.4, 0, 0.2, 1) 0ms,border 250ms cubic-bezier(0.4, 0, 0.2, 1) 0ms; font-family: "Roboto", "Helvetica", "Arial", sans-serif; font-weight: 500; line-height: 1.75; border-radius: 4px; letter-spacing: 0.02857em; text-transform: uppercase; } .MuiButton-root:hover { text-decoration: none; background-color: rgba(0, 0, 0, 0.04); } .MuiButton-root.Mui-disabled { color: rgba(0, 0, 0, 0.26); } @media (hover: none) { .MuiButton-root:hover { background-color: transparent; } } .MuiButton-root:hover.Mui-disabled { background-color: transparent; } .MuiButton-label { width: 100%; display: inherit; align-items: inherit; justify-content: inherit; } .MuiButton-text { padding: 6px 8px; } .MuiButton-textPrimary { color: #2a3442; } .MuiButton-textPrimary:hover { background-color: rgba(42, 52, 66, 0.04); } @media (hover: none) { .MuiButton-textPrimary:hover { background-color: transparent; } } .MuiButton-textSecondary { color: #DD275B; } .MuiButton-textSecondary:hover { background-color: rgba(221, 39, 91, 0.04); } @media (hover: none) { .MuiButton-textSecondary:hover { background-color: transparent; } } .MuiButton-outlined { border: 1px solid rgba(0, 0, 0, 0.23); padding: 5px 15px; } .MuiButton-outlined.Mui-disabled { border: 1px solid rgba(0, 0, 0, 0.12); } .MuiButton-outlinedPrimary { color: #2a3442; border: 1px solid rgba(42, 52, 66, 0.5); } .MuiButton-outlinedPrimary:hover { border: 1px solid #2a3442; background-color: rgba(42, 52, 66, 0.04); } @media (hover: none) { .MuiButton-outlinedPrimary:hover { background-color: transparent; } } .MuiButton-outlinedSecondary { color: #DD275B; border: 1px solid rgba(221, 39, 91, 0.5); } .MuiButton-outlinedSecondary:hover { border: 1px solid #DD275B; background-color: rgba(221, 39, 91, 0.04); } .MuiButton-outlinedSecondary.Mui-disabled { border: 1px solid rgba(0, 0, 0, 0.26); } @media (hover: none) { .MuiButton-outlinedSecondary:hover { background-color: transparent; } } .MuiButton-contained { color: rgba(0, 0, 0, 0.87); box-shadow: 0px 3px 1px -2px rgba(0,0,0,0.2),0px 2px 2px 0px rgba(0,0,0,0.14),0px 1px 5px 0px rgba(0,0,0,0.12); background-color: #e0e0e0; } .MuiButton-contained:hover { box-shadow: 0px 2px 4px -1px rgba(0,0,0,0.2),0px 4px 5px 0px rgba(0,0,0,0.14),0px 1px 10px 0px rgba(0,0,0,0.12); background-color: #d5d5d5; } .MuiButton-contained.Mui-focusVisible { box-shadow: 0px 3px 5px -1px rgba(0,0,0,0.2),0px 6px 10px 0px rgba(0,0,0,0.14),0px 1px 18px 0px rgba(0,0,0,0.12); } .MuiButton-contained:active { box-shadow: 0px 5px 5px -3px rgba(0,0,0,0.2),0px 8px 10px 1px rgba(0,0,0,0.14),0px 3px 14px 2px rgba(0,0,0,0.12); } .MuiButton-contained.Mui-disabled { color: rgba(0, 0, 0, 0.26); box-shadow: none; background-color: rgba(0, 0, 0, 0.12); } @media (hover: none) { .MuiButton-contained:hover { box-shadow: 0px 3px 1px -2px rgba(0,0,0,0.2),0px 2px 2px 0px rgba(0,0,0,0.14),0px 1px 5px 0px rgba(0,0,0,0.12); background-color: #e0e0e0; } } .MuiButton-contained:hover.Mui-disabled { background-color: rgba(0, 0, 0, 0.12); } .MuiButton-containedPrimary { color: #ffffff; background-color: #2a3442; } .MuiButton-containedPrimary:hover { background-color: rgb(29, 36, 46); } @media (hover: none) { .MuiButton-containedPrimary:hover { background-color: #2a3442; } } .MuiButton-containedSecondary { color: #ffffff; background-color: #DD275B; } .MuiButton-containedSecondary:hover { background-color: rgb(154, 27, 63); } @media (hover: none) { .MuiButton-containedSecondary:hover { background-color: #DD275B; } } .MuiButton-disableElevation { box-shadow: none; } .MuiButton-disableElevation:hover { box-shadow: none; } .MuiButton-disableElevation.Mui-focusVisible { box-shadow: none; } .MuiButton-disableElevation:active { box-shadow: none; } .MuiButton-disableElevation.Mui-disabled { box-shadow: none; } .MuiButton-colorInherit { color: inherit; border-color: currentColor; } .MuiButton-textSizeSmall { padding: 4px 5px; font-size: 0.8125rem; } .MuiButton-textSizeLarge { padding: 8px 11px; font-size: 0.9375rem; } .MuiButton-outlinedSizeSmall { padding: 3px 9px; font-size: 0.8125rem; } .MuiButton-outlinedSizeLarge { padding: 7px 21px; font-size: 0.9375rem; } .MuiButton-containedSizeSmall { padding: 4px 10px; font-size: 0.8125rem; } .MuiButton-containedSizeLarge { padding: 8px 22px; font-size: 0.9375rem; } .MuiButton-fullWidth { width: 100%; } .MuiButton-startIcon { display: inherit; margin-left: -4px; margin-right: 8px; } .MuiButton-startIcon.MuiButton-iconSizeSmall { margin-left: -2px; } .MuiButton-endIcon { display: inherit; margin-left: 8px; margin-right: -4px; } .MuiButton-endIcon.MuiButton-iconSizeSmall { margin-right: -2px; } .MuiButton-iconSizeSmall > *:first-child { font-size: 18px; } .MuiButton-iconSizeMedium > *:first-child { font-size: 20px; } .MuiButton-iconSizeLarge > *:first-child { font-size: 22px; } .MuiContainer-root { width: 100%; display: block; box-sizing: border-box; margin-left: auto; margin-right: auto; padding-left: 16px; padding-right: 16px; } @media (min-width:600px) { .MuiContainer-root { padding-left: 24px; padding-right: 24px; } } .MuiContainer-disableGutters { padding-left: 0; padding-right: 0; } @media (min-width:600px) { .MuiContainer-fixed { max-width: 600px; } } @media (min-width:960px) { .MuiContainer-fixed { max-width: 960px; } } @media (min-width:1280px) { .MuiContainer-fixed { max-width: 1280px; } } @media (min-width:1920px) { .MuiContainer-fixed { max-width: 1920px; } } @media (min-width:0px) { .MuiContainer-maxWidthXs { max-width: 444px; } } @media (min-width:600px) { .MuiContainer-maxWidthSm { max-width: 600px; } } @media (min-width:960px) { .MuiContainer-maxWidthMd { max-width: 960px; } } @media (min-width:1280px) { .MuiContainer-maxWidthLg { max-width: 1280px; } } @media (min-width:1920px) { .MuiContainer-maxWidthXl { max-width: 1920px; } } @media print { .MuiDialog-root { position: absolute !important; } } .MuiDialog-scrollPaper { display: flex; align-items: center; justify-content: center; } .MuiDialog-scrollBody { overflow-x: hidden; overflow-y: auto; text-align: center; } .MuiDialog-scrollBody:after { width: 0; height: 100%; content: ""; display: inline-block; vertical-align: middle; } .MuiDialog-container { height: 100%; outline: 0; } @media print { .MuiDialog-container { height: auto; } } .MuiDialog-paper { margin: 32px; position: relative; overflow-y: auto; } @media print { .MuiDialog-paper { box-shadow: none; overflow-y: visible; } } .MuiDialog-paperScrollPaper { display: flex; max-height: calc(100% - 64px); flex-direction: column; } .MuiDialog-paperScrollBody { display: inline-block; text-align: left; vertical-align: middle; } .MuiDialog-paperWidthFalse { max-width: calc(100% - 64px); } .MuiDialog-paperWidthXs { max-width: 444px; } @media (max-width:507.95px) { .MuiDialog-paperWidthXs.MuiDialog-paperScrollBody { max-width: calc(100% - 64px); } } .MuiDialog-paperWidthSm { max-width: 600px; } @media (max-width:663.95px) { .MuiDialog-paperWidthSm.MuiDialog-paperScrollBody { max-width: calc(100% - 64px); } } .MuiDialog-paperWidthMd { max-width: 960px; } @media (max-width:1023.95px) { .MuiDialog-paperWidthMd.MuiDialog-paperScrollBody { max-width: calc(100% - 64px); } } .MuiDialog-paperWidthLg { max-width: 1280px; } @media (max-width:1343.95px) { .MuiDialog-paperWidthLg.MuiDialog-paperScrollBody { max-width: calc(100% - 64px); } } .MuiDialog-paperWidthXl { max-width: 1920px; } @media (max-width:1983.95px) { .MuiDialog-paperWidthXl.MuiDialog-paperScrollBody { max-width: calc(100% - 64px); } } .MuiDialog-paperFullWidth { width: calc(100% - 64px); } .MuiDialog-paperFullScreen { width: 100%; height: 100%; margin: 0; max-width: 100%; max-height: none; border-radius: 0; } .MuiDialog-paperFullScreen.MuiDialog-paperScrollBody { margin: 0; max-width: 100%; } .MuiGrid-container { width: 100%; display: flex; flex-wrap: wrap; box-sizing: border-box; } .MuiGrid-item { margin: 0; box-sizing: border-box; } .MuiGrid-zeroMinWidth { min-width: 0; } .MuiGrid-direction-xs-column { flex-direction: column; } .MuiGrid-direction-xs-column-reverse { flex-direction: column-reverse; } .MuiGrid-direction-xs-row-reverse { flex-direction: row-reverse; } .MuiGrid-wrap-xs-nowrap { flex-wrap: nowrap; } .MuiGrid-wrap-xs-wrap-reverse { flex-wrap: wrap-reverse; } .MuiGrid-align-items-xs-center { align-items: center; } .MuiGrid-align-items-xs-flex-start { align-items: flex-start; } .MuiGrid-align-items-xs-flex-end { align-items: flex-end; } .MuiGrid-align-items-xs-baseline { align-items: baseline; } .MuiGrid-align-content-xs-center { align-content: center; } .MuiGrid-align-content-xs-flex-start { align-content: flex-start; } .MuiGrid-align-content-xs-flex-end { align-content: flex-end; } .MuiGrid-align-content-xs-space-between { align-content: space-between; } .MuiGrid-align-content-xs-space-around { align-content: space-around; } .MuiGrid-justify-content-xs-center { justify-content: center; } .MuiGrid-justify-content-xs-flex-end { justify-content: flex-end; } .MuiGrid-justify-content-xs-space-between { justify-content: space-between; } .MuiGrid-justify-content-xs-space-around { justify-content: space-around; } .MuiGrid-justify-content-xs-space-evenly { justify-content: space-evenly; } .MuiGrid-spacing-xs-1 { width: calc(100% + 8px); margin: -4px; } .MuiGrid-spacing-xs-1 > .MuiGrid-item { padding: 4px; } .MuiGrid-spacing-xs-2 { width: calc(100% + 16px); margin: -8px; } .MuiGrid-spacing-xs-2 > .MuiGrid-item { padding: 8px; } .MuiGrid-spacing-xs-3 { width: calc(100% + 24px); margin: -12px; } .MuiGrid-spacing-xs-3 > .MuiGrid-item { padding: 12px; } .MuiGrid-spacing-xs-4 { width: calc(100% + 32px); margin: -16px; } .MuiGrid-spacing-xs-4 > .MuiGrid-item { padding: 16px; } .MuiGrid-spacing-xs-5 { width: calc(100% + 40px); margin: -20px; } .MuiGrid-spacing-xs-5 > .MuiGrid-item { padding: 20px; } .MuiGrid-spacing-xs-6 { width: calc(100% + 48px); margin: -24px; } .MuiGrid-spacing-xs-6 > .MuiGrid-item { padding: 24px; } .MuiGrid-spacing-xs-7 { width: calc(100% + 56px); margin: -28px; } .MuiGrid-spacing-xs-7 > .MuiGrid-item { padding: 28px; } .MuiGrid-spacing-xs-8 { width: calc(100% + 64px); margin: -32px; } .MuiGrid-spacing-xs-8 > .MuiGrid-item { padding: 32px; } .MuiGrid-spacing-xs-9 { width: calc(100% + 72px); margin: -36px; } .MuiGrid-spacing-xs-9 > .MuiGrid-item { padding: 36px; } .MuiGrid-spacing-xs-10 { width: calc(100% + 80px); margin: -40px; } .MuiGrid-spacing-xs-10 > .MuiGrid-item { padding: 40px; } .MuiGrid-grid-xs-auto { flex-grow: 0; max-width: none; flex-basis: auto; } .MuiGrid-grid-xs-true { flex-grow: 1; max-width: 100%; flex-basis: 0; } .MuiGrid-grid-xs-1 { flex-grow: 0; max-width: 8.333333%; flex-basis: 8.333333%; } .MuiGrid-grid-xs-2 { flex-grow: 0; max-width: 16.666667%; flex-basis: 16.666667%; } .MuiGrid-grid-xs-3 { flex-grow: 0; max-width: 25%; flex-basis: 25%; } .MuiGrid-grid-xs-4 { flex-grow: 0; max-width: 33.333333%; flex-basis: 33.333333%; } .MuiGrid-grid-xs-5 { flex-grow: 0; max-width: 41.666667%; flex-basis: 41.666667%; } .MuiGrid-grid-xs-6 { flex-grow: 0; max-width: 50%; flex-basis: 50%; } .MuiGrid-grid-xs-7 { flex-grow: 0; max-width: 58.333333%; flex-basis: 58.333333%; } .MuiGrid-grid-xs-8 { flex-grow: 0; max-width: 66.666667%; flex-basis: 66.666667%; } .MuiGrid-grid-xs-9 { flex-grow: 0; max-width: 75%; flex-basis: 75%; } .MuiGrid-grid-xs-10 { flex-grow: 0; max-width: 83.333333%; flex-basis: 83.333333%; } .MuiGrid-grid-xs-11 { flex-grow: 0; max-width: 91.666667%; flex-basis: 91.666667%; } .MuiGrid-grid-xs-12 { flex-grow: 0; max-width: 100%; flex-basis: 100%; } @media (min-width:600px) { .MuiGrid-grid-sm-auto { flex-grow: 0; max-width: none; flex-basis: auto; } .MuiGrid-grid-sm-true { flex-grow: 1; max-width: 100%; flex-basis: 0; } .MuiGrid-grid-sm-1 { flex-grow: 0; max-width: 8.333333%; flex-basis: 8.333333%; } .MuiGrid-grid-sm-2 { flex-grow: 0; max-width: 16.666667%; flex-basis: 16.666667%; } .MuiGrid-grid-sm-3 { flex-grow: 0; max-width: 25%; flex-basis: 25%; } .MuiGrid-grid-sm-4 { flex-grow: 0; max-width: 33.333333%; flex-basis: 33.333333%; } .MuiGrid-grid-sm-5 { flex-grow: 0; max-width: 41.666667%; flex-basis: 41.666667%; } .MuiGrid-grid-sm-6 { flex-grow: 0; max-width: 50%; flex-basis: 50%; } .MuiGrid-grid-sm-7 { flex-grow: 0; max-width: 58.333333%; flex-basis: 58.333333%; } .MuiGrid-grid-sm-8 { flex-grow: 0; max-width: 66.666667%; flex-basis: 66.666667%; } .MuiGrid-grid-sm-9 { flex-grow: 0; max-width: 75%; flex-basis: 75%; } .MuiGrid-grid-sm-10 { flex-grow: 0; max-width: 83.333333%; flex-basis: 83.333333%; } .MuiGrid-grid-sm-11 { flex-grow: 0; max-width: 91.666667%; flex-basis: 91.666667%; } .MuiGrid-grid-sm-12 { flex-grow: 0; max-width: 100%; flex-basis: 100%; } } @media (min-width:960px) { .MuiGrid-grid-md-auto { flex-grow: 0; max-width: none; flex-basis: auto; } .MuiGrid-grid-md-true { flex-grow: 1; max-width: 100%; flex-basis: 0; } .MuiGrid-grid-md-1 { flex-grow: 0; max-width: 8.333333%; flex-basis: 8.333333%; } .MuiGrid-grid-md-2 { flex-grow: 0; max-width: 16.666667%; flex-basis: 16.666667%; } .MuiGrid-grid-md-3 { flex-grow: 0; max-width: 25%; flex-basis: 25%; } .MuiGrid-grid-md-4 { flex-grow: 0; max-width: 33.333333%; flex-basis: 33.333333%; } .MuiGrid-grid-md-5 { flex-grow: 0; max-width: 41.666667%; flex-basis: 41.666667%; } .MuiGrid-grid-md-6 { flex-grow: 0; max-width: 50%; flex-basis: 50%; } .MuiGrid-grid-md-7 { flex-grow: 0; max-width: 58.333333%; flex-basis: 58.333333%; } .MuiGrid-grid-md-8 { flex-grow: 0; max-width: 66.666667%; flex-basis: 66.666667%; } .MuiGrid-grid-md-9 { flex-grow: 0; max-width: 75%; flex-basis: 75%; } .MuiGrid-grid-md-10 { flex-grow: 0; max-width: 83.333333%; flex-basis: 83.333333%; } .MuiGrid-grid-md-11 { flex-grow: 0; max-width: 91.666667%; flex-basis: 91.666667%; } .MuiGrid-grid-md-12 { flex-grow: 0; max-width: 100%; flex-basis: 100%; } } @media (min-width:1280px) { .MuiGrid-grid-lg-auto { flex-grow: 0; max-width: none; flex-basis: auto; } .MuiGrid-grid-lg-true { flex-grow: 1; max-width: 100%; flex-basis: 0; } .MuiGrid-grid-lg-1 { flex-grow: 0; max-width: 8.333333%; flex-basis: 8.333333%; } .MuiGrid-grid-lg-2 { flex-grow: 0; max-width: 16.666667%; flex-basis: 16.666667%; } .MuiGrid-grid-lg-3 { flex-grow: 0; max-width: 25%; flex-basis: 25%; } .MuiGrid-grid-lg-4 { flex-grow: 0; max-width: 33.333333%; flex-basis: 33.333333%; } .MuiGrid-grid-lg-5 { flex-grow: 0; max-width: 41.666667%; flex-basis: 41.666667%; } .MuiGrid-grid-lg-6 { flex-grow: 0; max-width: 50%; flex-basis: 50%; } .MuiGrid-grid-lg-7 { flex-grow: 0; max-width: 58.333333%; flex-basis: 58.333333%; } .MuiGrid-grid-lg-8 { flex-grow: 0; max-width: 66.666667%; flex-basis: 66.666667%; } .MuiGrid-grid-lg-9 { flex-grow: 0; max-width: 75%; flex-basis: 75%; } .MuiGrid-grid-lg-10 { flex-grow: 0; max-width: 83.333333%; flex-basis: 83.333333%; } .MuiGrid-grid-lg-11 { flex-grow: 0; max-width: 91.666667%; flex-basis: 91.666667%; } .MuiGrid-grid-lg-12 { flex-grow: 0; max-width: 100%; flex-basis: 100%; } } @media (min-width:1920px) { .MuiGrid-grid-xl-auto { flex-grow: 0; max-width: none; flex-basis: auto; } .MuiGrid-grid-xl-true { flex-grow: 1; max-width: 100%; flex-basis: 0; } .MuiGrid-grid-xl-1 { flex-grow: 0; max-width: 8.333333%; flex-basis: 8.333333%; } .MuiGrid-grid-xl-2 { flex-grow: 0; max-width: 16.666667%; flex-basis: 16.666667%; } .MuiGrid-grid-xl-3 { flex-grow: 0; max-width: 25%; flex-basis: 25%; } .MuiGrid-grid-xl-4 { flex-grow: 0; max-width: 33.333333%; flex-basis: 33.333333%; } .MuiGrid-grid-xl-5 { flex-grow: 0; max-width: 41.666667%; flex-basis: 41.666667%; } .MuiGrid-grid-xl-6 { flex-grow: 0; max-width: 50%; flex-basis: 50%; } .MuiGrid-grid-xl-7 { flex-grow: 0; max-width: 58.333333%; flex-basis: 58.333333%; } .MuiGrid-grid-xl-8 { flex-grow: 0; max-width: 66.666667%; flex-basis: 66.666667%; } .MuiGrid-grid-xl-9 { flex-grow: 0; max-width: 75%; flex-basis: 75%; } .MuiGrid-grid-xl-10 { flex-grow: 0; max-width: 83.333333%; flex-basis: 83.333333%; } .MuiGrid-grid-xl-11 { flex-grow: 0; max-width: 91.666667%; flex-basis: 91.666667%; } .MuiGrid-grid-xl-12 { flex-grow: 0; max-width: 100%; flex-basis: 100%; } } .MuiLink-underlineNone { text-decoration: none; } .MuiLink-underlineHover { text-decoration: none; } .MuiLink-underlineHover:hover { text-decoration: underline; } .MuiLink-underlineAlways { text-decoration: underline; } .MuiLink-button { border: 0; cursor: pointer; margin: 0; outline: 0; padding: 0; position: relative; user-select: none; border-radius: 0; vertical-align: middle; -moz-appearance: none; background-color: transparent; -webkit-appearance: none; -webkit-tap-highlight-color: transparent; } .MuiLink-button::-moz-focus-inner { border-style: none; } .MuiLink-button.Mui-focusVisible { outline: auto; } .MuiToolbar-root { display: flex; position: relative; align-items: center; } .MuiToolbar-gutters { padding-left: 16px; padding-right: 16px; } @media (min-width:600px) { .MuiToolbar-gutters { padding-left: 24px; padding-right: 24px; } } .MuiToolbar-regular { min-height: 56px; } @media (min-width:0px) and (orientation: landscape) { .MuiToolbar-regular { min-height: 48px; } } @media (min-width:600px) { .MuiToolbar-regular { min-height: 64px; } } .MuiToolbar-dense { min-height: 48px; } .jss64 { padding: 24px; min-height: 100%; padding-bottom: 32px; } .jss65 { margin-bottom: 16px; } .jss44 { margin-top: 16px; margin-bottom: 6.4px; } .jss45 { margin-top: 0; margin-bottom: 0; } .jss46 { margin-top: 16px; } .jss47 { margin-top: 8px; margin-bottom: 8px; } .jss48 { padding-top: 8px; } .jss49 { vertical-align: center; } .jss50 { margin-top: 8px; vertical-align: center; } .jss51 { padding: 0; margin-top: 24px; margin-bottom: 24px; } .jss52 { padding-top: 16px; } .jss53 { color: #DD275B; display: flex; align-items: center; margin-bottom: 8px; } .jss54 { text-transform: Capitalize; } .jss55 { top: 8px; color: #9e9e9e; right: 8px; position: absolute; } .jss56 { margin-bottom: 8px; } .jss57 { margin-top: 8px; } .jss58 { margin-top: 8px; } .jss59 { margin-top: 16px; } .jss60 { margin-top: 16px; margin-left: 24px; margin-right: 24px; margin-bottom: 24px; } .jss61 { cursor: pointer; } .jss62 { padding: 0; margin-top: 16px; margin-bottom: 24px; list-style-type: none; } .jss67 { width: 100%; } .jss68 { font-size: 0.9375rem; font-weight: bold; } .jss69 { color: rgba(0, 0, 0, 0.54); margin-top: 8px; margin-bottom: 8px; } .jss10 { padding: 24px; } .jss11 { margin-top: 16px; text-align: left; } .jss13 { margin-top: 24px; } .jss14 { margin-top: 0; } .jss15 { margin-bottom: 16px; } .jss16 { margin-bottom: 16px; text-transform: capitalize; } .jss17 { margin-bottom: 8px; text-transform: capitalize; } .jss18 { margin-bottom: 8px; text-transform: Capitalize; } .jss19 { margin-top: 32px; } .jss20 { margin-right: 8px; } .jss21 { top: 8px; color: #9e9e9e; right: 8px; position: absolute; } .jss22 { margin-top: 24px; } .jss23 { margin-top: 8px; } .jss24 { margin-top: 16px; margin-bottom: 16px; } .jss25 { margin-top: 8px; margin-bottom: 16px; } .jss26 { color: rgba(0, 0, 0, 0.38); } .jss27 { padding-left: 24px; margin-bottom: 8px; padding-right: 24px; flex-direction: column; } .jss28 { min-height: 80px; padding-left: 24px; padding-right: 24px; } .jss29 { color: rgba(0, 0, 0, 0.54); } .jss30 { margin-top: 16px; } .jss31 { color: #81c784; padding-left: 4px; } .jss32 { color: #e57373; padding-left: 4px; } .jss34 { width: 100%; margin-top: 24px; } .jss35 { color: #e57373; font-style: italic; margin-top: 0; text-align: center; padding-top: 0; padding-left: 40px; margin-bottom: 32px; padding-right: 40px; } .jss36 { width: 100%; height: 100%; margin-top: 24px; margin-left: 8px; margin-right: 8px; margin-bottom: 8px; } .jss37 { margin-top: 24px; } .jss38 { margin-right: 16px; } .jss39 { margin-bottom: 16px; } .jss40 { margin-bottom: 16px; } .jss41 { list-style: square outside; padding-left: 15px; margin-bottom: 0; } .jss42 { margin-bottom: 8px; } .jss2 { flex-grow: 1; background-color: #2a3442; } .jss3 { width: 8rem; height: 100%; text-align: left; } .jss4 { flex-grow: 1; text-align: center; } .jss5 { padding: 12px; text-align: center; } .jss6 { text-align: right; } .jss7 { color: white; text-decoration: none; } .jss7:hover { text-decoration: none; } .jss8 { text-decoration: none; } .jss8:hover { text-decoration: none; } .jss72 { padding: 16px; text-align: center; } .jss1 { max-width: 1920px; margin-left: auto; margin-right: auto; }</style><style data-href="https://fonts.googleapis.com/css?family=Roboto:300,400,500,700&display=swap">@font-face{font-family:'Roboto';font-style:normal;font-weight:300;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOlCnqEu92Fr1MmSU5fBBc-.woff) format('woff')}@font-face{font-family:'Roboto';font-style:normal;font-weight:400;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOmCnqEu92Fr1Mu4mxM.woff) format('woff')}@font-face{font-family:'Roboto';font-style:normal;font-weight:500;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOlCnqEu92Fr1MmEU9fBBc-.woff) format('woff')}@font-face{font-family:'Roboto';font-style:normal;font-weight:700;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOlCnqEu92Fr1MmWUlfBBc-.woff) format('woff')}@font-face{font-family:'Roboto';font-style:normal;font-weight:300;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOlCnqEu92Fr1MmSU5fCRc4AMP6lbBP.woff2) format('woff2');unicode-range:U+0460-052F,U+1C80-1C88,U+20B4,U+2DE0-2DFF,U+A640-A69F,U+FE2E-FE2F}@font-face{font-family:'Roboto';font-style:normal;font-weight:300;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOlCnqEu92Fr1MmSU5fABc4AMP6lbBP.woff2) format('woff2');unicode-range:U+0301,U+0400-045F,U+0490-0491,U+04B0-04B1,U+2116}@font-face{font-family:'Roboto';font-style:normal;font-weight:300;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOlCnqEu92Fr1MmSU5fCBc4AMP6lbBP.woff2) format('woff2');unicode-range:U+1F00-1FFF}@font-face{font-family:'Roboto';font-style:normal;font-weight:300;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOlCnqEu92Fr1MmSU5fBxc4AMP6lbBP.woff2) format('woff2');unicode-range:U+0370-03FF}@font-face{font-family:'Roboto';font-style:normal;font-weight:300;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOlCnqEu92Fr1MmSU5fCxc4AMP6lbBP.woff2) format('woff2');unicode-range:U+0102-0103,U+0110-0111,U+0128-0129,U+0168-0169,U+01A0-01A1,U+01AF-01B0,U+1EA0-1EF9,U+20AB}@font-face{font-family:'Roboto';font-style:normal;font-weight:300;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOlCnqEu92Fr1MmSU5fChc4AMP6lbBP.woff2) format('woff2');unicode-range:U+0100-024F,U+0259,U+1E00-1EFF,U+2020,U+20A0-20AB,U+20AD-20CF,U+2113,U+2C60-2C7F,U+A720-A7FF}@font-face{font-family:'Roboto';font-style:normal;font-weight:300;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOlCnqEu92Fr1MmSU5fBBc4AMP6lQ.woff2) format('woff2');unicode-range:U+0000-00FF,U+0131,U+0152-0153,U+02BB-02BC,U+02C6,U+02DA,U+02DC,U+2000-206F,U+2074,U+20AC,U+2122,U+2191,U+2193,U+2212,U+2215,U+FEFF,U+FFFD}@font-face{font-family:'Roboto';font-style:normal;font-weight:400;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOmCnqEu92Fr1Mu72xKKTU1Kvnz.woff2) format('woff2');unicode-range:U+0460-052F,U+1C80-1C88,U+20B4,U+2DE0-2DFF,U+A640-A69F,U+FE2E-FE2F}@font-face{font-family:'Roboto';font-style:normal;font-weight:400;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOmCnqEu92Fr1Mu5mxKKTU1Kvnz.woff2) format('woff2');unicode-range:U+0301,U+0400-045F,U+0490-0491,U+04B0-04B1,U+2116}@font-face{font-family:'Roboto';font-style:normal;font-weight:400;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOmCnqEu92Fr1Mu7mxKKTU1Kvnz.woff2) format('woff2');unicode-range:U+1F00-1FFF}@font-face{font-family:'Roboto';font-style:normal;font-weight:400;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOmCnqEu92Fr1Mu4WxKKTU1Kvnz.woff2) format('woff2');unicode-range:U+0370-03FF}@font-face{font-family:'Roboto';font-style:normal;font-weight:400;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOmCnqEu92Fr1Mu7WxKKTU1Kvnz.woff2) format('woff2');unicode-range:U+0102-0103,U+0110-0111,U+0128-0129,U+0168-0169,U+01A0-01A1,U+01AF-01B0,U+1EA0-1EF9,U+20AB}@font-face{font-family:'Roboto';font-style:normal;font-weight:400;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOmCnqEu92Fr1Mu7GxKKTU1Kvnz.woff2) format('woff2');unicode-range:U+0100-024F,U+0259,U+1E00-1EFF,U+2020,U+20A0-20AB,U+20AD-20CF,U+2113,U+2C60-2C7F,U+A720-A7FF}@font-face{font-family:'Roboto';font-style:normal;font-weight:400;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOmCnqEu92Fr1Mu4mxKKTU1Kg.woff2) format('woff2');unicode-range:U+0000-00FF,U+0131,U+0152-0153,U+02BB-02BC,U+02C6,U+02DA,U+02DC,U+2000-206F,U+2074,U+20AC,U+2122,U+2191,U+2193,U+2212,U+2215,U+FEFF,U+FFFD}@font-face{font-family:'Roboto';font-style:normal;font-weight:500;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOlCnqEu92Fr1MmEU9fCRc4AMP6lbBP.woff2) format('woff2');unicode-range:U+0460-052F,U+1C80-1C88,U+20B4,U+2DE0-2DFF,U+A640-A69F,U+FE2E-FE2F}@font-face{font-family:'Roboto';font-style:normal;font-weight:500;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOlCnqEu92Fr1MmEU9fABc4AMP6lbBP.woff2) format('woff2');unicode-range:U+0301,U+0400-045F,U+0490-0491,U+04B0-04B1,U+2116}@font-face{font-family:'Roboto';font-style:normal;font-weight:500;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOlCnqEu92Fr1MmEU9fCBc4AMP6lbBP.woff2) format('woff2');unicode-range:U+1F00-1FFF}@font-face{font-family:'Roboto';font-style:normal;font-weight:500;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOlCnqEu92Fr1MmEU9fBxc4AMP6lbBP.woff2) format('woff2');unicode-range:U+0370-03FF}@font-face{font-family:'Roboto';font-style:normal;font-weight:500;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOlCnqEu92Fr1MmEU9fCxc4AMP6lbBP.woff2) format('woff2');unicode-range:U+0102-0103,U+0110-0111,U+0128-0129,U+0168-0169,U+01A0-01A1,U+01AF-01B0,U+1EA0-1EF9,U+20AB}@font-face{font-family:'Roboto';font-style:normal;font-weight:500;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOlCnqEu92Fr1MmEU9fChc4AMP6lbBP.woff2) format('woff2');unicode-range:U+0100-024F,U+0259,U+1E00-1EFF,U+2020,U+20A0-20AB,U+20AD-20CF,U+2113,U+2C60-2C7F,U+A720-A7FF}@font-face{font-family:'Roboto';font-style:normal;font-weight:500;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOlCnqEu92Fr1MmEU9fBBc4AMP6lQ.woff2) format('woff2');unicode-range:U+0000-00FF,U+0131,U+0152-0153,U+02BB-02BC,U+02C6,U+02DA,U+02DC,U+2000-206F,U+2074,U+20AC,U+2122,U+2191,U+2193,U+2212,U+2215,U+FEFF,U+FFFD}@font-face{font-family:'Roboto';font-style:normal;font-weight:700;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOlCnqEu92Fr1MmWUlfCRc4AMP6lbBP.woff2) format('woff2');unicode-range:U+0460-052F,U+1C80-1C88,U+20B4,U+2DE0-2DFF,U+A640-A69F,U+FE2E-FE2F}@font-face{font-family:'Roboto';font-style:normal;font-weight:700;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOlCnqEu92Fr1MmWUlfABc4AMP6lbBP.woff2) format('woff2');unicode-range:U+0301,U+0400-045F,U+0490-0491,U+04B0-04B1,U+2116}@font-face{font-family:'Roboto';font-style:normal;font-weight:700;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOlCnqEu92Fr1MmWUlfCBc4AMP6lbBP.woff2) format('woff2');unicode-range:U+1F00-1FFF}@font-face{font-family:'Roboto';font-style:normal;font-weight:700;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOlCnqEu92Fr1MmWUlfBxc4AMP6lbBP.woff2) format('woff2');unicode-range:U+0370-03FF}@font-face{font-family:'Roboto';font-style:normal;font-weight:700;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOlCnqEu92Fr1MmWUlfCxc4AMP6lbBP.woff2) format('woff2');unicode-range:U+0102-0103,U+0110-0111,U+0128-0129,U+0168-0169,U+01A0-01A1,U+01AF-01B0,U+1EA0-1EF9,U+20AB}@font-face{font-family:'Roboto';font-style:normal;font-weight:700;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOlCnqEu92Fr1MmWUlfChc4AMP6lbBP.woff2) format('woff2');unicode-range:U+0100-024F,U+0259,U+1E00-1EFF,U+2020,U+20A0-20AB,U+20AD-20CF,U+2113,U+2C60-2C7F,U+A720-A7FF}@font-face{font-family:'Roboto';font-style:normal;font-weight:700;font-display:swap;src:url(https://fonts.gstatic.com/s/roboto/v30/KFOlCnqEu92Fr1MmWUlfBBc4AMP6lQ.woff2) format('woff2');unicode-range:U+0000-00FF,U+0131,U+0152-0153,U+02BB-02BC,U+02C6,U+02DA,U+02DC,U+2000-206F,U+2074,U+20AC,U+2122,U+2191,U+2193,U+2212,U+2215,U+FEFF,U+FFFD}</style></head><body><div id="__next"><header class="MuiPaper-root MuiAppBar-root MuiAppBar-positionStatic MuiAppBar-colorPrimary jss2 MuiPaper-elevation4"><div class="MuiToolbar-root MuiToolbar-regular MuiToolbar-gutters"><a class="MuiTypography-root MuiLink-root MuiLink-underlineHover MuiTypography-colorInherit" href="/"><svg class="MuiSvgIcon-root jss3" focusable="false" viewBox="0 0 792 167.3" aria-hidden="true"><path d="M91 125.8h23.8c-3.5 13.3-10.2 23.5-20 30.5-9.9 7.3-22.2 10.9-37.2 10.9-18.1 0-32.2-5.9-42.4-17.6C5.1 138.2 0 121.9 0 100.6 0 80.3 4.9 64.4 14.8 53 25 41.2 39.1 35.3 57.2 35.3c19.1 0 33.8 5.7 44.3 17.2 5.7 7 9.8 15.1 12.4 24.3H80.5c-1.6-3.2-3.2-5.5-4.7-7.1-4.2-4.4-10-6.7-17.6-6.7-7 0-12.7 2.2-17.2 6.7-5.7 6.4-8.6 16.9-8.6 31.5 0 14.6 2.9 24.9 8.6 31 4.1 5.1 10.3 7.6 18.6 7.6 5.4 0 10-1.1 13.8-3.3 1-.3 1.8-.9 2.6-1.7l2.6-2.6c.6-1 1.9-2.2 3.8-3.8 2-1.8 4.8-2.6 8.6-2.6zm46.6 27.7c-6.7-5.7-11.4-13.4-14.3-23.1-2.9-9.7-4.3-19.8-4.3-30.3 0-8.6 1.2-17.2 3.6-25.7 2.4-8.6 6.1-15.8 11.2-21.4 8.3-9.5 18.9-15.2 31.9-16.9 13-1.7 24.8-.7 35.3 3.1 12.1 4.7 21 13 26.7 24.8 5.4 10.5 8.1 22.7 8.1 36.7 0 10.2-1.1 18.9-3.3 26.2-2.2 7.3-5.1 13.5-8.6 18.6-7.7 10.5-17.4 17-29.1 19.5-10.5 2.9-21.1 3.1-31.7.7-10.6-2.4-19.1-6.5-25.5-12.2zm22.9-83.9c-6.7 7.3-9.7 18.2-9 32.7.6 14.5 3.3 24.6 8.1 30.3 1.9 2.6 5.2 4.7 10 6.4 4.8 1.8 9.6 1.9 14.5.5s9.3-5 13.1-10.7c3.8-5.7 5.9-14.9 6.2-27.6 0-11.4-1.8-20-5.5-25.7-3.6-5.7-7.9-9.4-12.6-11-4.7-1.6-9.5-1.7-14.3-.2-4.7 1.2-8.2 3.1-10.5 5.3zm191.1 95.3H335c-4.8 0-8.7-1.5-11.7-4.5s-4.5-6.9-4.5-11.7V83.9c0-7.6-2.3-13.2-6.9-16.7-4.6-3.5-9.8-5.2-15.5-5.2-5.7 0-10.8 1.8-15.2 5.2-4.5 3.5-6.7 9.1-6.7 16.7v81h-33.3V90.6c0-21.6 5.6-36.1 16.9-43.4 11.3-7.3 23.7-11.3 37.4-11.9 14 0 26.8 3.7 38.6 11s17.6 22.1 17.6 44.3v74.3zm218-39.1h23.8c-3.5 13.3-10.2 23.5-20 30.5-9.9 7.3-22.3 10.9-37.2 10.9-18.1 0-32.3-5.9-42.4-17.6-10.2-11.4-15.3-27.8-15.3-49.1 0-20.3 4.9-36.2 14.8-47.6 10.2-11.8 24.3-17.7 42.4-17.7 19.1 0 33.8 5.7 44.3 17.2 10.2 11.8 15.2 28.1 15.2 49.1v5.2c0 1.6-.2 2.7-.5 3.3h-82.4c.3 9.8 2.7 17.2 7.1 21.9 4.1 5.1 10.3 7.6 18.6 7.6 5.4 0 10-1.1 13.8-3.3 1-.3 1.8-.9 2.6-1.7l2.6-2.6c.3-1 1.5-2.2 3.6-3.8 2.2-1.5 5.2-2.3 9-2.3zm-57.2-37.1H561c-.6-8.6-2.8-14.9-6.7-19.1-4.1-4.4-10-6.7-17.7-6.7-7 0-12.7 2.2-17.1 6.7-4.4 4.4-6.8 10.8-7.1 19.1zm88.2 76.2v-61.5c0-12.4 1.8-22.8 5.5-31.2 3.7-8.4 8.7-15.2 15-20.2 6-4.8 13.1-8.3 21.2-10.5 8.1-2.2 16.4-3.3 25-3.3h4.8V72h-10.9c-9.2 0-16.1 2.2-20.5 6.6-4.5 4.5-6.7 11.5-6.7 21v65.3h-33.4zm131 0c-10.5.6-21.8.5-34.1-.5s-18.3-8.7-18.3-23.3V.9h17.2c4.1 0 7.8 1.6 10.9 4.8 3.2 3.2 4.8 7 4.8 11.4v21.4h19.5v6.7c0 4.7-1.6 8.6-4.7 11.7-3.2 3-7 4.5-11.4 4.5h-3.3V132c0 5.4 3.2 8.1 9.5 8.1h10v24.8z"></path><path opacity=".5" d="M362.6 42.5l-4.3 11.4 14.3 40.9 15.6-43.2"></path><path opacity=".75" d="M405.7 36.7L379 113.1l14.3 41 38-108.4"></path><path d="M483 45.3L474.6 0l-35 30 8.3 2.9-45.6 132-.1.1H431l42.6-123"></path><path d="M741.6 139.6h20.8v3.9h-8.2v21.8h-4.5v-21.8h-8.1v-3.9zm23.7 0h6.3l7.1 20.1h.1l6.9-20.1h6.3v25.7h-4.3v-19.8h-.1l-7.1 19.8h-3.7l-7.1-19.8h-.1v19.8h-4.3v-25.7z"></path></svg></a><h2 class="MuiTypography-root jss4 MuiTypography-h6"><a class="MuiTypography-root MuiLink-root MuiLink-underlineHover jss7 MuiTypography-colorPrimary" href="/calculator/"></a></h2></div></header><span> <script type="text/javascript"> window._mfq = window._mfq || []; (function() { var mf = document.createElement("script"); mf.type = "text/javascript"; mf.defer = true; mf.src = "//cdn.mouseflow.com/projects/a5cb0b60-3f33-4c54-8a22-fcfc6fe2b5b4.js"; document.getElementsByTagName("head")[0].appendChild(mf); })(); </script> </span><div class="MuiBox-root jss9 jss1"><main class="MuiGrid-root jss10 MuiGrid-container MuiGrid-spacing-xs-3 MuiGrid-align-items-xs-flex-start MuiGrid-justify-content-xs-center"><div class="MuiGrid-root jss12 MuiGrid-item MuiGrid-grid-xs-12 MuiGrid-grid-md-4"><div class="MuiContainer-root MuiContainer-maxWidthXl" style="padding:0"><div class="MuiPaper-root jss64 MuiPaper-elevation1 MuiPaper-rounded"><div class="MuiBox-root jss66 jss61"><h5 class="MuiTypography-root jss53 MuiTypography-h5 MuiTypography-colorSecondary">Preferences<svg class="MuiSvgIcon-root" focusable="false" viewBox="0 0 24 24" aria-hidden="true" style="margin-left:8px"><path d="M19.14 12.94c.04-.3.06-.61.06-.94 0-.32-.02-.64-.07-.94l2.03-1.58c.18-.14.23-.41.12-.61l-1.92-3.32c-.12-.22-.37-.29-.59-.22l-2.39.96c-.5-.38-1.03-.7-1.62-.94l-.36-2.54c-.04-.24-.24-.41-.48-.41h-3.84c-.24 0-.43.17-.47.41l-.36 2.54c-.59.24-1.13.57-1.62.94l-2.39-.96c-.22-.08-.47 0-.59.22L2.74 8.87c-.12.21-.08.47.12.61l2.03 1.58c-.05.3-.09.63-.09.94s.02.64.07.94l-2.03 1.58c-.18.14-.23.41-.12.61l1.92 3.32c.12.22.37.29.59.22l2.39-.96c.5.38 1.03.7 1.62.94l.36 2.54c.05.24.24.41.48.41h3.84c.24 0 .44-.17.47-.41l.36-2.54c.59-.24 1.13-.56 1.62-.94l2.39.96c.22.08.47 0 .59-.22l1.92-3.32c.12-.22.07-.47-.12-.61l-2.01-1.58zM12 15.6c-1.98 0-3.6-1.62-3.6-3.6s1.62-3.6 3.6-3.6 3.6 1.62 3.6 3.6-1.62 3.6-3.6 3.6z"></path></svg></h5><ul class="MuiTypography-root jss62 MuiTypography-body1"><li><strong>Metric: </strong>Conversion Rate</li><li><strong>Statistics: </strong>Z-Test</li><li><strong>Tails: </strong>2</li><li><strong>Confidence: </strong>95%</li><li><strong>Power: </strong>80%</li><li><strong>SRM Confidence: </strong>99%</li></ul></div><button class="MuiButtonBase-root MuiButton-root MuiButton-contained jss44 MuiButton-fullWidth" tabindex="0" type="button" autofocus=""><span class="MuiButton-label">Start Here<span class="MuiButton-endIcon MuiButton-iconSizeMedium"><svg class="MuiSvgIcon-root" focusable="false" viewBox="0 0 24 24" aria-hidden="true"><path d="M10 16.5l6-4.5-6-4.5v9zM12 2C6.48 2 2 6.48 2 12s4.48 10 10 10 10-4.48 10-10S17.52 2 12 2zm0 18c-4.41 0-8-3.59-8-8s3.59-8 8-8 8 3.59 8 8-3.59 8-8 8z"></path></svg></span></span></button></div></div><div class="MuiContainer-root jss37 MuiContainer-maxWidthXl" style="padding:0"><div class="MuiPaper-root jss64 MuiPaper-elevation1 MuiPaper-rounded"><h3 class="MuiTypography-root jss17 MuiTypography-h5 MuiTypography-colorSecondary">Our Calculators</h3><ul class="jss41"><li class="jss42"><p class="MuiTypography-root MuiTypography-body1 MuiTypography-noWrap"><a class="MuiTypography-root MuiLink-root MuiLink-underlineHover MuiTypography-colorPrimary" href="/calculator/conversion-rate/">CR: Conversion Rate A/B Testing Calculator</a></p></li><li class="jss42"><p class="MuiTypography-root MuiTypography-body1 MuiTypography-noWrap"><a class="MuiTypography-root MuiLink-root MuiLink-underlineHover MuiTypography-colorPrimary" href="/calculator/average-order-value/">AOV: Average Order Value A/B Testing Calculator</a></p></li><li class="jss42" style="padding-bottom:0;margin-bottom:0"><p class="MuiTypography-root MuiTypography-body1 MuiTypography-noWrap"><a class="MuiTypography-root MuiLink-root MuiLink-underlineHover MuiTypography-colorPrimary" href="/calculator/revenue-per-visitor/">RPV: Average Revenue Per Visitor A/B Testing Calculator</a></p></li></ul></div></div></div><div class="MuiGrid-root jss12 MuiGrid-item MuiGrid-grid-xs-12 MuiGrid-grid-md-8"><div class="MuiContainer-root MuiContainer-maxWidthXl" style="padding:0"><div class="MuiPaper-root jss64 MuiPaper-elevation1 MuiPaper-rounded"><h1 class="MuiTypography-root jss16 MuiTypography-h5 MuiTypography-colorSecondary">A/B Testing Significance Calculator: Supports Revenue Metrics like AOV &amp; ARPV</h1><div class="MuiTypography-root jss40 MuiTypography-body1 MuiTypography-colorTextSecondary"> Welcome to Convert.com’s <strong>A/B testing calculator</strong>. It does significance, p-value, power, sample size, MDE calculations, and supports both <strong>test planning</strong> and <strong>post hoc analysis</strong> for conversion rate, average order value, and revenue per visitor metrics. </div><div class="MuiGrid-root MuiGrid-container MuiGrid-spacing-xs-2"><div class="MuiGrid-root MuiGrid-item MuiGrid-grid-xs-12 MuiGrid-grid-md-4"><img src="rocket-launch.svg" class="jss34" alt="A/B Testing Statistical Calculator"/></div><div class="MuiGrid-root MuiGrid-item MuiGrid-grid-xs-12 MuiGrid-grid-md-8"><div class="jss67"><div class="MuiPaper-root MuiAccordion-root jss69 MuiAccordion-rounded MuiPaper-elevation1 MuiPaper-rounded"><div class="MuiButtonBase-root MuiAccordionSummary-root" tabindex="0" role="button" aria-disabled="false" aria-expanded="false" aria-controls="panel0bh-content" id="panel0bh-header"><div class="MuiAccordionSummary-content"><p class="MuiTypography-root jss68 MuiTypography-body1">How do you calculate the sample size for an A/B test?</p></div><div class="MuiButtonBase-root MuiIconButton-root MuiAccordionSummary-expandIcon MuiIconButton-edgeEnd" aria-disabled="false" aria-hidden="true"><span class="MuiIconButton-label"><svg class="MuiSvgIcon-root" focusable="false" viewBox="0 0 24 24" aria-hidden="true"><path d="M16.59 8.59L12 13.17 7.41 8.59 6 10l6 6 6-6z"></path></svg></span></div></div><div class="MuiCollapse-root MuiCollapse-hidden" style="min-height:0px"><div class="MuiCollapse-wrapper"><div class="MuiCollapse-wrapperInner"><div aria-labelledby="panel0bh-header" id="panel0bh-content" role="region"><div class="MuiAccordionDetails-root"><div class="MuiTypography-root MuiTypography-body1"> <p>To do this, we do power calculations based on the weekly values that you provide us with.</p> <p>The sample size for an A/B test is one of the key factors that Conversion Rate Optimizers look to when deciding whether running a test is feasible or not. This comes down to common sense. If given your preferred statistical significance threshold and power setting, the sample size required is three times the monthly traffic to a site or an online property, the experiment would be interminable.</p> <p>In general, the stricter you are with the risk you are willing to accept your test result being due to random chance, the larger sample size you require to reach a conclusive winner.</p> <p> Here are some of the factors on which the calculation of sample size depends: <ul> <li>The control’s conversion rate</li> <li>The MDE you are willing to work with</li> <li>The statistical significance setting</li> <li>The power or sensitivity of a test</li> <li>The type of test - whether it is one-tailed or two-tailed</li> </ul> </p> </div></div></div></div></div></div></div></div><div class="jss67"><div class="MuiPaper-root MuiAccordion-root jss69 MuiAccordion-rounded MuiPaper-elevation1 MuiPaper-rounded"><div class="MuiButtonBase-root MuiAccordionSummary-root" tabindex="0" role="button" aria-disabled="false" aria-expanded="false" aria-controls="panel1bh-content" id="panel1bh-header"><div class="MuiAccordionSummary-content"><p class="MuiTypography-root jss68 MuiTypography-body1">What is a conversion rate?</p></div><div class="MuiButtonBase-root MuiIconButton-root MuiAccordionSummary-expandIcon MuiIconButton-edgeEnd" aria-disabled="false" aria-hidden="true"><span class="MuiIconButton-label"><svg class="MuiSvgIcon-root" focusable="false" viewBox="0 0 24 24" aria-hidden="true"><path d="M16.59 8.59L12 13.17 7.41 8.59 6 10l6 6 6-6z"></path></svg></span></div></div><div class="MuiCollapse-root MuiCollapse-hidden" style="min-height:0px"><div class="MuiCollapse-wrapper"><div class="MuiCollapse-wrapperInner"><div aria-labelledby="panel1bh-header" id="panel1bh-content" role="region"><div class="MuiAccordionDetails-root"><div class="MuiTypography-root MuiTypography-body1"> <p>A conversion rate is a ratio of conversions over visitors. If you have an equal number of visitors and conversions it is 1 or 100%. Usually, your number of conversions will always be less than the number of visitors, so the conversion rate of a page will always be inferior to 1 or 100%. Let’s say you had 100 visitors to a given page on a given day, and out of those 10 converted.</p> <p><strong>Our conversion rate is then 10/100 = 0.1 = 10%.</strong></p> </div></div></div></div></div></div></div></div><div class="jss67"><div class="MuiPaper-root MuiAccordion-root jss69 MuiAccordion-rounded MuiPaper-elevation1 MuiPaper-rounded"><div class="MuiButtonBase-root MuiAccordionSummary-root" tabindex="0" role="button" aria-disabled="false" aria-expanded="false" aria-controls="panel2bh-content" id="panel2bh-header"><div class="MuiAccordionSummary-content"><p class="MuiTypography-root jss68 MuiTypography-body1">What is statistical significance in A/B testing?</p></div><div class="MuiButtonBase-root MuiIconButton-root MuiAccordionSummary-expandIcon MuiIconButton-edgeEnd" aria-disabled="false" aria-hidden="true"><span class="MuiIconButton-label"><svg class="MuiSvgIcon-root" focusable="false" viewBox="0 0 24 24" aria-hidden="true"><path d="M16.59 8.59L12 13.17 7.41 8.59 6 10l6 6 6-6z"></path></svg></span></div></div><div class="MuiCollapse-root MuiCollapse-hidden" style="min-height:0px"><div class="MuiCollapse-wrapper"><div class="MuiCollapse-wrapperInner"><div aria-labelledby="panel2bh-header" id="panel2bh-content" role="region"><div class="MuiAccordionDetails-root"><div class="MuiTypography-root MuiTypography-body1"> <p>The statistical significance in A/B testing is when the p-value becomes inferior to our significance threshold. It signifies that our null hypothesis is highly unlikely to be true, hence it proves that we have the effects we are observing are not due to random chance.</p> <p>Let us assume you’re running an A/B test on two landing pages selling the same product. The first one (we’ll call it A, or the control) does not have 3D product images. The second one (we’ll call it B, or the variation) has them.</p> <p>The conversion rate in terms of “Add to Cart” is 7% for A and 9% for B. So should you just add 3D images to your product pages across the site?</p> <p>No! Because all the visitors to your website have not seen page B and you can’t make assumptions about their preferences simply from observing the behavior of a much smaller sample size. Right? (PS: Don’t make assumptions in marketing or optimization… being data-driven is the way to go).</p> <p>How to solve this little problem?</p> <p>P-value comes to the rescue.</p> <p>P-value gives you the probability that you have seen a 2 percentage point increase in the “Add to Cart” KPI for your variation (Page B) or a more extreme result if the null hypothesis (that there is really no change) was true. If it is inferior to or less than the “risk” you are willing to accept - the standardized value of this being 5% (the significance level) - then you can be reasonably confident of your test (at your chosen level of confidence, in that case, 100% - 5% significance level = 95% confidence level).</p> </div></div></div></div></div></div></div></div><div class="jss67"><div class="MuiPaper-root MuiAccordion-root jss69 MuiAccordion-rounded MuiPaper-elevation1 MuiPaper-rounded"><div class="MuiButtonBase-root MuiAccordionSummary-root" tabindex="0" role="button" aria-disabled="false" aria-expanded="false" aria-controls="panel3bh-content" id="panel3bh-header"><div class="MuiAccordionSummary-content"><p class="MuiTypography-root jss68 MuiTypography-body1">What is the power of an A/B test?</p></div><div class="MuiButtonBase-root MuiIconButton-root MuiAccordionSummary-expandIcon MuiIconButton-edgeEnd" aria-disabled="false" aria-hidden="true"><span class="MuiIconButton-label"><svg class="MuiSvgIcon-root" focusable="false" viewBox="0 0 24 24" aria-hidden="true"><path d="M16.59 8.59L12 13.17 7.41 8.59 6 10l6 6 6-6z"></path></svg></span></div></div><div class="MuiCollapse-root MuiCollapse-hidden" style="min-height:0px"><div class="MuiCollapse-wrapper"><div class="MuiCollapse-wrapperInner"><div aria-labelledby="panel3bh-header" id="panel3bh-content" role="region"><div class="MuiAccordionDetails-root"><div class="MuiTypography-root MuiTypography-body1"> <p>The power of an A/B test is a measure of how likely we are to observe an effect if it is present. Usually, we want it to be at least 80%. The higher the better, it assures us that we are not missing anything!</p> <p>It plays an important role in sample size calculations because, along with the MDE (minimum detectable effect) and the confidence level, it allows us to determine the required sample size to wait before analyzing a test.</p> </div></div></div></div></div></div></div></div><div class="jss67"><div class="MuiPaper-root MuiAccordion-root jss69 MuiAccordion-rounded MuiPaper-elevation1 MuiPaper-rounded"><div class="MuiButtonBase-root MuiAccordionSummary-root" tabindex="0" role="button" aria-disabled="false" aria-expanded="false" aria-controls="panel4bh-content" id="panel4bh-header"><div class="MuiAccordionSummary-content"><p class="MuiTypography-root jss68 MuiTypography-body1">What is the confidence level of an A/B test? How does it differ from significance?</p></div><div class="MuiButtonBase-root MuiIconButton-root MuiAccordionSummary-expandIcon MuiIconButton-edgeEnd" aria-disabled="false" aria-hidden="true"><span class="MuiIconButton-label"><svg class="MuiSvgIcon-root" focusable="false" viewBox="0 0 24 24" aria-hidden="true"><path d="M16.59 8.59L12 13.17 7.41 8.59 6 10l6 6 6-6z"></path></svg></span></div></div><div class="MuiCollapse-root MuiCollapse-hidden" style="min-height:0px"><div class="MuiCollapse-wrapper"><div class="MuiCollapse-wrapperInner"><div aria-labelledby="panel4bh-header" id="panel4bh-content" role="region"><div class="MuiAccordionDetails-root"><div class="MuiTypography-root MuiTypography-body1"> <p> Both the confidence level and the significance level are two sides of the same coin! <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>C</mi><mi>o</mi><mi>n</mi><mi>f</mi><mi>i</mi><mi>d</mi><mi>e</mi><mi>n</mi><mi>c</mi><mi>e</mi><mo>=</mo><mn>1</mn><mo>−</mo><mi>S</mi><mi>i</mi><mi>g</mi><mi>n</mi><mi>i</mi><mi>f</mi><mi>i</mi><mi>c</mi><mi>a</mi><mi>n</mi><mi>c</mi><mi>e</mi></mrow><annotation encoding="application/x-tex">Confidence = 1 - Significance</annotation></semantics></math></span><span class="katex-html" aria-hidden="true"><span class="base"><span class="strut" style="height:0.8888799999999999em;vertical-align:-0.19444em;"></span><span class="mord mathnormal" style="margin-right:0.07153em;">C</span><span class="mord mathnormal">o</span><span class="mord mathnormal">n</span><span class="mord mathnormal" style="margin-right:0.10764em;">f</span><span class="mord mathnormal">i</span><span class="mord mathnormal">d</span><span class="mord mathnormal">e</span><span class="mord mathnormal">n</span><span class="mord mathnormal">c</span><span class="mord mathnormal">e</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mrel">=</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span></span><span class="base"><span class="strut" style="height:0.72777em;vertical-align:-0.08333em;"></span><span class="mord">1</span><span class="mspace" style="margin-right:0.2222222222222222em;"></span><span class="mbin">−</span><span class="mspace" style="margin-right:0.2222222222222222em;"></span></span><span class="base"><span class="strut" style="height:0.8888799999999999em;vertical-align:-0.19444em;"></span><span class="mord mathnormal" style="margin-right:0.05764em;">S</span><span class="mord mathnormal">i</span><span class="mord mathnormal" style="margin-right:0.03588em;">g</span><span class="mord mathnormal">n</span><span class="mord mathnormal">i</span><span class="mord mathnormal" style="margin-right:0.10764em;">f</span><span class="mord mathnormal">i</span><span class="mord mathnormal">c</span><span class="mord mathnormal">a</span><span class="mord mathnormal">n</span><span class="mord mathnormal">c</span><span class="mord mathnormal">e</span></span></span></span></span> <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML" display="block"><semantics><mrow><mi>S</mi><mi>i</mi><mi>g</mi><mi>n</mi><mi>i</mi><mi>f</mi><mi>i</mi><mi>c</mi><mi>a</mi><mi>n</mi><mi>c</mi><mi>e</mi><mo>=</mo><mn>1</mn><mo>−</mo><mi>C</mi><mi>o</mi><mi>n</mi><mi>f</mi><mi>i</mi><mi>d</mi><mi>e</mi><mi>n</mi><mi>c</mi><mi>e</mi></mrow><annotation encoding="application/x-tex">Significance = 1 - Confidence</annotation></semantics></math></span><span class="katex-html" aria-hidden="true"><span class="base"><span class="strut" style="height:0.8888799999999999em;vertical-align:-0.19444em;"></span><span class="mord mathnormal" style="margin-right:0.05764em;">S</span><span class="mord mathnormal">i</span><span class="mord mathnormal" style="margin-right:0.03588em;">g</span><span class="mord mathnormal">n</span><span class="mord mathnormal">i</span><span class="mord mathnormal" style="margin-right:0.10764em;">f</span><span class="mord mathnormal">i</span><span class="mord mathnormal">c</span><span class="mord mathnormal">a</span><span class="mord mathnormal">n</span><span class="mord mathnormal">c</span><span class="mord mathnormal">e</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mrel">=</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span></span><span class="base"><span class="strut" style="height:0.72777em;vertical-align:-0.08333em;"></span><span class="mord">1</span><span class="mspace" style="margin-right:0.2222222222222222em;"></span><span class="mbin">−</span><span class="mspace" style="margin-right:0.2222222222222222em;"></span></span><span class="base"><span class="strut" style="height:0.8888799999999999em;vertical-align:-0.19444em;"></span><span class="mord mathnormal" style="margin-right:0.07153em;">C</span><span class="mord mathnormal">o</span><span class="mord mathnormal">n</span><span class="mord mathnormal" style="margin-right:0.10764em;">f</span><span class="mord mathnormal">i</span><span class="mord mathnormal">d</span><span class="mord mathnormal">e</span><span class="mord mathnormal">n</span><span class="mord mathnormal">c</span><span class="mord mathnormal">e</span></span></span></span></span> </p> <p>Hence if we have a confidence level of 95%, it entails a significance level of 1 - 95% = 5% = 0.05. We can then use the significance level value to compare against our p-value. If our p-value < 0.05, we say that our A/B test has reached “statistical significance”, with a confidence level of 95%.</p> </div></div></div></div></div></div></div></div><div class="jss67"><div class="MuiPaper-root MuiAccordion-root jss69 MuiAccordion-rounded MuiPaper-elevation1 MuiPaper-rounded"><div class="MuiButtonBase-root MuiAccordionSummary-root" tabindex="0" role="button" aria-disabled="false" aria-expanded="false" aria-controls="panel5bh-content" id="panel5bh-header"><div class="MuiAccordionSummary-content"><p class="MuiTypography-root jss68 MuiTypography-body1">What is an MDE?</p></div><div class="MuiButtonBase-root MuiIconButton-root MuiAccordionSummary-expandIcon MuiIconButton-edgeEnd" aria-disabled="false" aria-hidden="true"><span class="MuiIconButton-label"><svg class="MuiSvgIcon-root" focusable="false" viewBox="0 0 24 24" aria-hidden="true"><path d="M16.59 8.59L12 13.17 7.41 8.59 6 10l6 6 6-6z"></path></svg></span></div></div><div class="MuiCollapse-root MuiCollapse-hidden" style="min-height:0px"><div class="MuiCollapse-wrapper"><div class="MuiCollapse-wrapperInner"><div aria-labelledby="panel5bh-header" id="panel5bh-content" role="region"><div class="MuiAccordionDetails-root"><div class="MuiTypography-root MuiTypography-body1"> <p>MDE stands for Minimum Detectable Effect and is simply the minimum effect size that would be worth it for us to observe, under which the cost or effort of implementing the new variant wouldn’t be worth it.</p> <p>The more power you give your test, the more “sensitive” it is to detecting conversion lifts. This is why tests with higher power can have smaller Minimum Detectable Effects (MDE), and in general, require larger sample sizes to conclude.</p> </div></div></div></div></div></div></div></div><div class="jss67"><div class="MuiPaper-root MuiAccordion-root jss69 MuiAccordion-rounded MuiPaper-elevation1 MuiPaper-rounded"><div class="MuiButtonBase-root MuiAccordionSummary-root" tabindex="0" role="button" aria-disabled="false" aria-expanded="false" aria-controls="panel6bh-content" id="panel6bh-header"><div class="MuiAccordionSummary-content"><p class="MuiTypography-root jss68 MuiTypography-body1">What is SRM?</p></div><div class="MuiButtonBase-root MuiIconButton-root MuiAccordionSummary-expandIcon MuiIconButton-edgeEnd" aria-disabled="false" aria-hidden="true"><span class="MuiIconButton-label"><svg class="MuiSvgIcon-root" focusable="false" viewBox="0 0 24 24" aria-hidden="true"><path d="M16.59 8.59L12 13.17 7.41 8.59 6 10l6 6 6-6z"></path></svg></span></div></div><div class="MuiCollapse-root MuiCollapse-hidden" style="min-height:0px"><div class="MuiCollapse-wrapper"><div class="MuiCollapse-wrapperInner"><div aria-labelledby="panel6bh-header" id="panel6bh-content" role="region"><div class="MuiAccordionDetails-root"><div class="MuiTypography-root MuiTypography-body1"> <p>SRM stands for Sample Ratio Mismatch and is a statistical test that allows us to check if the sample ratios per variant differ too much from their predefined levels or not.</p> <p>Hence it can be used as a sanity check, to make sure that no problem has happened during the sample collection. Like a failure of the randomization system that could cause unequal bucketing.</p> <p>For instance, if we have two variants, one is the control and the other is the variant with 50% of traffic distribution each, but at the end of the test, we see that one has 5500 visitors and the other only 4900. In that case, the SRM test would return positive! But if the second had 5400 visitors, it would return negative as 5500 and 5400 are “close enough” to be due to random chance.</p> </div></div></div></div></div></div></div></div><div class="jss67"><div class="MuiPaper-root MuiAccordion-root jss69 MuiAccordion-rounded MuiPaper-elevation1 MuiPaper-rounded"><div class="MuiButtonBase-root MuiAccordionSummary-root" tabindex="0" role="button" aria-disabled="false" aria-expanded="false" aria-controls="panel7bh-content" id="panel7bh-header"><div class="MuiAccordionSummary-content"><p class="MuiTypography-root jss68 MuiTypography-body1">What questions does this calculator answer?</p></div><div class="MuiButtonBase-root MuiIconButton-root MuiAccordionSummary-expandIcon MuiIconButton-edgeEnd" aria-disabled="false" aria-hidden="true"><span class="MuiIconButton-label"><svg class="MuiSvgIcon-root" focusable="false" viewBox="0 0 24 24" aria-hidden="true"><path d="M16.59 8.59L12 13.17 7.41 8.59 6 10l6 6 6-6z"></path></svg></span></div></div><div class="MuiCollapse-root MuiCollapse-hidden" style="min-height:0px"><div class="MuiCollapse-wrapper"><div class="MuiCollapse-wrapperInner"><div aria-labelledby="panel7bh-header" id="panel7bh-content" role="region"><div class="MuiAccordionDetails-root"><div class="MuiTypography-root MuiTypography-body1"> <p>This calculator answers questions about the three most-used metrics in A/B testing, conversion rate, average order value, and average revenue per visitor. It can handle both pre-test and post-test scenarios.</p> <p>In the <strong>pre-test mode</strong>, it does test planning by calculating the minimum detectable effects that would work for up to 12 weeks, given the current traffic and conversion values. For instance, given 5000 visitors per week with 250 of those converting, we can observe at least those Minimum Detectable Effects in a statistically significant fashion over a period of weeks. You can then choose a compromise depending on how long you are ready to wait and how small a Lift you wouldn’t want to miss.</p> <p>In its <strong>post-test mode</strong>, it does post hoc results analysis, using power calculations it can predict dynamically how advanced the test currently is.</p> <p>Both modes support revenue metrics, for pre-test you will need a CSV file with one column of a week’s worth of order values to run MDE calculations for it. For post-test, your CSV needs to have at least 2 columns of order values for the duration of your experiment.</p> </div></div></div></div></div></div></div></div><div class="jss67"><div class="MuiPaper-root MuiAccordion-root jss69 MuiAccordion-rounded MuiPaper-elevation1 MuiPaper-rounded"><div class="MuiButtonBase-root MuiAccordionSummary-root" tabindex="0" role="button" aria-disabled="false" aria-expanded="false" aria-controls="panel8bh-content" id="panel8bh-header"><div class="MuiAccordionSummary-content"><p class="MuiTypography-root jss68 MuiTypography-body1">What are Type I vs Type II errors?</p></div><div class="MuiButtonBase-root MuiIconButton-root MuiAccordionSummary-expandIcon MuiIconButton-edgeEnd" aria-disabled="false" aria-hidden="true"><span class="MuiIconButton-label"><svg class="MuiSvgIcon-root" focusable="false" viewBox="0 0 24 24" aria-hidden="true"><path d="M16.59 8.59L12 13.17 7.41 8.59 6 10l6 6 6-6z"></path></svg></span></div></div><div class="MuiCollapse-root MuiCollapse-hidden" style="min-height:0px"><div class="MuiCollapse-wrapper"><div class="MuiCollapse-wrapperInner"><div aria-labelledby="panel8bh-header" id="panel8bh-content" role="region"><div class="MuiAccordionDetails-root"><div class="MuiTypography-root MuiTypography-body1"> <p>A <strong>Type I error</strong> is simply a false positive, for example when the test shows that a variant is a winner but in reality, it’s not. The reason for it is really nothing else than random chance. What you can do is properly “control” the probability of making such an error, let’s say to 5% (in the case of a 95% confidence level) by planning your test properly and sticking to the plan. In other words, you should not look at the results before a certain time or number of samples have been collected.</p> <p><strong>In other words, we dynamically compute the test progress in percentage form based on the effect size at the moment observation, with the desired confidence and power levels targets.</strong></p> <p>The second type of error that can happen are <strong>Type II errors</strong>. Those are nothing other than false negatives. <p>In reality, there is a change, but it fails to show up at the time that we look at our results and we run away thinking that our variant is under-performing! The way to control this error is to wait for the test to accumulate enough power before assuming that a change is not present! The recommended minimum power level is 80%, but the more the better! Here again, our calculator has a test-progress estimation that will take the desired power level into consideration.</p> <p>We have written an exhaustive blog on this subject. Check it out <a class="MuiTypography-root MuiLink-root MuiLink-underlineHover MuiTypography-colorPrimary" href="https://www.convert.com/blog/optimization/type-i-type-ii-errors-inevitable-in-optimization-experiements/" target="_blank">here</a>.</p> </div></div></div></div></div></div></div></div></div></div></div></div><div class="MuiContainer-root jss22 MuiContainer-maxWidthXl" style="padding:0"><div class="MuiPaper-root jss64 MuiPaper-elevation1 MuiPaper-rounded"><div class="MuiBox-root jss70"><a class="MuiTypography-root MuiLink-root MuiLink-underlineHover MuiTypography-colorPrimary" href="https://www.convert.com/free-trial/#subscribeFreeTrial"><img src="join-convert.svg" class="jss34" alt="Convert.com - Affordable A/B Testing Software!"/></a></div></div></div></div></main></div><footer class="MuiPaper-root jss71 MuiPaper-outlined"><p class="MuiTypography-root jss72 MuiTypography-body2">© <!-- -->2023<!-- -->, Convert Inc. All rights reserved.</p></footer></div><script id="__NEXT_DATA__" type="application/json">{"props":{"pageProps":{"slug":"","title":"A/B Testing Significance Calculator. Free. Supports AOV and ARPV.","description":"Looking for an A/B testing significance calculator to calculate AOV and ARPV? Need a check to not peek at test results? Plan with Convert’s calculator.","h1":"A/B Testing Significance Calculator: Supports Revenue Metrics like AOV \u0026 ARPV","intro":"\n Welcome to Convert.com’s \u003cstrong\u003eA/B testing calculator\u003c/strong\u003e. It does significance, p-value, power, sample size, MDE calculations, and supports both \u003cstrong\u003etest planning\u003c/strong\u003e and \u003cstrong\u003epost hoc analysis\u003c/strong\u003e for conversion rate, average order value, and revenue per visitor metrics.\n ","faqs":[{"q":"How do you calculate the sample size for an A/B test?","a":"\n \u003cp\u003eTo do this, we do power calculations based on the weekly values that you provide us with.\u003c/p\u003e\n \u003cp\u003eThe sample size for an A/B test is one of the key factors that Conversion Rate Optimizers look to when deciding whether running a test is feasible or not. This comes down to common sense. If given your preferred statistical significance threshold and power setting, the sample size required is three times the monthly traffic to a site or an online property, the experiment would be interminable.\u003c/p\u003e\n \u003cp\u003eIn general, the stricter you are with the risk you are willing to accept your test result being due to random chance, the larger sample size you require to reach a conclusive winner.\u003c/p\u003e\n \u003cp\u003e\n Here are some of the factors on which the calculation of sample size depends: \n \u003cul\u003e\n \u003cli\u003eThe control’s conversion rate\u003c/li\u003e\n \u003cli\u003eThe MDE you are willing to work with\u003c/li\u003e\n \u003cli\u003eThe statistical significance setting\u003c/li\u003e\n \u003cli\u003eThe power or sensitivity of a test\u003c/li\u003e\n \u003cli\u003eThe type of test - whether it is one-tailed or two-tailed\u003c/li\u003e\n \u003c/ul\u003e\n \u003c/p\u003e\n "},{"q":"What is a conversion rate?","a":"\n \u003cp\u003eA conversion rate is a ratio of conversions over visitors. If you have an equal number of visitors and conversions it is 1 or 100%. Usually, your number of conversions will always be less than the number of visitors, so the conversion rate of a page will always be inferior to 1 or 100%. Let’s say you had 100 visitors to a given page on a given day, and out of those 10 converted.\u003c/p\u003e\n \u003cp\u003e\u003cstrong\u003eOur conversion rate is then 10/100 = 0.1 = 10%.\u003c/strong\u003e\u003c/p\u003e\n "},{"q":"What is statistical significance in A/B testing?","a":"\n \u003cp\u003eThe statistical significance in A/B testing is when the p-value becomes inferior to our significance threshold. It signifies that our null hypothesis is highly unlikely to be true, hence it proves that we have the effects we are observing are not due to random chance.\u003c/p\u003e\n \u003cp\u003eLet us assume you’re running an A/B test on two landing pages selling the same product. The first one (we’ll call it A, or the control) does not have 3D product images. The second one (we’ll call it B, or the variation) has them.\u003c/p\u003e\n \u003cp\u003eThe conversion rate in terms of “Add to Cart” is 7% for A and 9% for B. So should you just add 3D images to your product pages across the site?\u003c/p\u003e\n \u003cp\u003eNo! Because all the visitors to your website have not seen page B and you can’t make assumptions about their preferences simply from observing the behavior of a much smaller sample size. Right? (PS: Don’t make assumptions in marketing or optimization… being data-driven is the way to go).\u003c/p\u003e\n \u003cp\u003eHow to solve this little problem?\u003c/p\u003e\n \u003cp\u003eP-value comes to the rescue.\u003c/p\u003e\n \u003cp\u003eP-value gives you the probability that you have seen a 2 percentage point increase in the “Add to Cart” KPI for your variation (Page B) or a more extreme result if the null hypothesis (that there is really no change) was true. If it is inferior to or less than the “risk” you are willing to accept - the standardized value of this being 5% (the significance level) - then you can be reasonably confident of your test (at your chosen level of confidence, in that case, 100% - 5% significance level = 95% confidence level).\u003c/p\u003e\n "},{"q":"What is the power of an A/B test?","a":"\n \u003cp\u003eThe power of an A/B test is a measure of how likely we are to observe an effect if it is present. Usually, we want it to be at least 80%. The higher the better, it assures us that we are not missing anything!\u003c/p\u003e\n \u003cp\u003eIt plays an important role in sample size calculations because, along with the MDE (minimum detectable effect) and the confidence level, it allows us to determine the required sample size to wait before analyzing a test.\u003c/p\u003e\n "},{"q":"What is the confidence level of an A/B test? How does it differ from significance?","a":"\n \u003cp\u003e\n Both the confidence level and the significance level are two sides of the same coin!\n \u003cspan class=\"katex-display\"\u003e\u003cspan class=\"katex\"\u003e\u003cspan class=\"katex-mathml\"\u003e\u003cmath xmlns=\"http://www.w3.org/1998/Math/MathML\" display=\"block\"\u003e\u003csemantics\u003e\u003cmrow\u003e\u003cmi\u003eC\u003c/mi\u003e\u003cmi\u003eo\u003c/mi\u003e\u003cmi\u003en\u003c/mi\u003e\u003cmi\u003ef\u003c/mi\u003e\u003cmi\u003ei\u003c/mi\u003e\u003cmi\u003ed\u003c/mi\u003e\u003cmi\u003ee\u003c/mi\u003e\u003cmi\u003en\u003c/mi\u003e\u003cmi\u003ec\u003c/mi\u003e\u003cmi\u003ee\u003c/mi\u003e\u003cmo\u003e=\u003c/mo\u003e\u003cmn\u003e1\u003c/mn\u003e\u003cmo\u003e−\u003c/mo\u003e\u003cmi\u003eS\u003c/mi\u003e\u003cmi\u003ei\u003c/mi\u003e\u003cmi\u003eg\u003c/mi\u003e\u003cmi\u003en\u003c/mi\u003e\u003cmi\u003ei\u003c/mi\u003e\u003cmi\u003ef\u003c/mi\u003e\u003cmi\u003ei\u003c/mi\u003e\u003cmi\u003ec\u003c/mi\u003e\u003cmi\u003ea\u003c/mi\u003e\u003cmi\u003en\u003c/mi\u003e\u003cmi\u003ec\u003c/mi\u003e\u003cmi\u003ee\u003c/mi\u003e\u003c/mrow\u003e\u003cannotation encoding=\"application/x-tex\"\u003eConfidence = 1 - Significance\u003c/annotation\u003e\u003c/semantics\u003e\u003c/math\u003e\u003c/span\u003e\u003cspan class=\"katex-html\" aria-hidden=\"true\"\u003e\u003cspan class=\"base\"\u003e\u003cspan class=\"strut\" style=\"height:0.8888799999999999em;vertical-align:-0.19444em;\"\u003e\u003c/span\u003e\u003cspan class=\"mord mathnormal\" style=\"margin-right:0.07153em;\"\u003eC\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003eo\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003en\u003c/span\u003e\u003cspan class=\"mord mathnormal\" style=\"margin-right:0.10764em;\"\u003ef\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003ei\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003ed\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003ee\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003en\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003ec\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003ee\u003c/span\u003e\u003cspan class=\"mspace\" style=\"margin-right:0.2777777777777778em;\"\u003e\u003c/span\u003e\u003cspan class=\"mrel\"\u003e=\u003c/span\u003e\u003cspan class=\"mspace\" style=\"margin-right:0.2777777777777778em;\"\u003e\u003c/span\u003e\u003c/span\u003e\u003cspan class=\"base\"\u003e\u003cspan class=\"strut\" style=\"height:0.72777em;vertical-align:-0.08333em;\"\u003e\u003c/span\u003e\u003cspan class=\"mord\"\u003e1\u003c/span\u003e\u003cspan class=\"mspace\" style=\"margin-right:0.2222222222222222em;\"\u003e\u003c/span\u003e\u003cspan class=\"mbin\"\u003e−\u003c/span\u003e\u003cspan class=\"mspace\" style=\"margin-right:0.2222222222222222em;\"\u003e\u003c/span\u003e\u003c/span\u003e\u003cspan class=\"base\"\u003e\u003cspan class=\"strut\" style=\"height:0.8888799999999999em;vertical-align:-0.19444em;\"\u003e\u003c/span\u003e\u003cspan class=\"mord mathnormal\" style=\"margin-right:0.05764em;\"\u003eS\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003ei\u003c/span\u003e\u003cspan class=\"mord mathnormal\" style=\"margin-right:0.03588em;\"\u003eg\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003en\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003ei\u003c/span\u003e\u003cspan class=\"mord mathnormal\" style=\"margin-right:0.10764em;\"\u003ef\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003ei\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003ec\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003ea\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003en\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003ec\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003ee\u003c/span\u003e\u003c/span\u003e\u003c/span\u003e\u003c/span\u003e\u003c/span\u003e\n \u003cspan class=\"katex-display\"\u003e\u003cspan class=\"katex\"\u003e\u003cspan class=\"katex-mathml\"\u003e\u003cmath xmlns=\"http://www.w3.org/1998/Math/MathML\" display=\"block\"\u003e\u003csemantics\u003e\u003cmrow\u003e\u003cmi\u003eS\u003c/mi\u003e\u003cmi\u003ei\u003c/mi\u003e\u003cmi\u003eg\u003c/mi\u003e\u003cmi\u003en\u003c/mi\u003e\u003cmi\u003ei\u003c/mi\u003e\u003cmi\u003ef\u003c/mi\u003e\u003cmi\u003ei\u003c/mi\u003e\u003cmi\u003ec\u003c/mi\u003e\u003cmi\u003ea\u003c/mi\u003e\u003cmi\u003en\u003c/mi\u003e\u003cmi\u003ec\u003c/mi\u003e\u003cmi\u003ee\u003c/mi\u003e\u003cmo\u003e=\u003c/mo\u003e\u003cmn\u003e1\u003c/mn\u003e\u003cmo\u003e−\u003c/mo\u003e\u003cmi\u003eC\u003c/mi\u003e\u003cmi\u003eo\u003c/mi\u003e\u003cmi\u003en\u003c/mi\u003e\u003cmi\u003ef\u003c/mi\u003e\u003cmi\u003ei\u003c/mi\u003e\u003cmi\u003ed\u003c/mi\u003e\u003cmi\u003ee\u003c/mi\u003e\u003cmi\u003en\u003c/mi\u003e\u003cmi\u003ec\u003c/mi\u003e\u003cmi\u003ee\u003c/mi\u003e\u003c/mrow\u003e\u003cannotation encoding=\"application/x-tex\"\u003eSignificance = 1 - Confidence\u003c/annotation\u003e\u003c/semantics\u003e\u003c/math\u003e\u003c/span\u003e\u003cspan class=\"katex-html\" aria-hidden=\"true\"\u003e\u003cspan class=\"base\"\u003e\u003cspan class=\"strut\" style=\"height:0.8888799999999999em;vertical-align:-0.19444em;\"\u003e\u003c/span\u003e\u003cspan class=\"mord mathnormal\" style=\"margin-right:0.05764em;\"\u003eS\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003ei\u003c/span\u003e\u003cspan class=\"mord mathnormal\" style=\"margin-right:0.03588em;\"\u003eg\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003en\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003ei\u003c/span\u003e\u003cspan class=\"mord mathnormal\" style=\"margin-right:0.10764em;\"\u003ef\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003ei\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003ec\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003ea\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003en\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003ec\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003ee\u003c/span\u003e\u003cspan class=\"mspace\" style=\"margin-right:0.2777777777777778em;\"\u003e\u003c/span\u003e\u003cspan class=\"mrel\"\u003e=\u003c/span\u003e\u003cspan class=\"mspace\" style=\"margin-right:0.2777777777777778em;\"\u003e\u003c/span\u003e\u003c/span\u003e\u003cspan class=\"base\"\u003e\u003cspan class=\"strut\" style=\"height:0.72777em;vertical-align:-0.08333em;\"\u003e\u003c/span\u003e\u003cspan class=\"mord\"\u003e1\u003c/span\u003e\u003cspan class=\"mspace\" style=\"margin-right:0.2222222222222222em;\"\u003e\u003c/span\u003e\u003cspan class=\"mbin\"\u003e−\u003c/span\u003e\u003cspan class=\"mspace\" style=\"margin-right:0.2222222222222222em;\"\u003e\u003c/span\u003e\u003c/span\u003e\u003cspan class=\"base\"\u003e\u003cspan class=\"strut\" style=\"height:0.8888799999999999em;vertical-align:-0.19444em;\"\u003e\u003c/span\u003e\u003cspan class=\"mord mathnormal\" style=\"margin-right:0.07153em;\"\u003eC\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003eo\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003en\u003c/span\u003e\u003cspan class=\"mord mathnormal\" style=\"margin-right:0.10764em;\"\u003ef\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003ei\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003ed\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003ee\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003en\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003ec\u003c/span\u003e\u003cspan class=\"mord mathnormal\"\u003ee\u003c/span\u003e\u003c/span\u003e\u003c/span\u003e\u003c/span\u003e\u003c/span\u003e\n \u003c/p\u003e\n \u003cp\u003eHence if we have a confidence level of 95%, it entails a significance level of 1 - 95% = 5% = 0.05. We can then use the significance level value to compare against our p-value. If our p-value \u003c 0.05, we say that our A/B test has reached “statistical significance”, with a confidence level of 95%.\u003c/p\u003e\n "},{"q":"What is an MDE?","a":"\n \u003cp\u003eMDE stands for Minimum Detectable Effect and is simply the minimum effect size that would be worth it for us to observe, under which the cost or effort of implementing the new variant wouldn’t be worth it.\u003c/p\u003e\n \u003cp\u003eThe more power you give your test, the more “sensitive” it is to detecting conversion lifts. This is why tests with higher power can have smaller Minimum Detectable Effects (MDE), and in general, require larger sample sizes to conclude.\u003c/p\u003e\n "},{"q":"What is SRM?","a":"\n \u003cp\u003eSRM stands for Sample Ratio Mismatch and is a statistical test that allows us to check if the sample ratios per variant differ too much from their predefined levels or not.\u003c/p\u003e\n \u003cp\u003eHence it can be used as a sanity check, to make sure that no problem has happened during the sample collection. Like a failure of the randomization system that could cause unequal bucketing.\u003c/p\u003e \n \u003cp\u003eFor instance, if we have two variants, one is the control and the other is the variant with 50% of traffic distribution each, but at the end of the test, we see that one has 5500 visitors and the other only 4900. In that case, the SRM test would return positive! But if the second had 5400 visitors, it would return negative as 5500 and 5400 are “close enough” to be due to random chance.\u003c/p\u003e\n "},{"q":"What questions does this calculator answer?","a":"\n \u003cp\u003eThis calculator answers questions about the three most-used metrics in A/B testing, conversion rate, average order value, and average revenue per visitor. It can handle both pre-test and post-test scenarios.\u003c/p\u003e\n \u003cp\u003eIn the \u003cstrong\u003epre-test mode\u003c/strong\u003e, it does test planning by calculating the minimum detectable effects that would work for up to 12 weeks, given the current traffic and conversion values. For instance, given 5000 visitors per week with 250 of those converting, we can observe at least those Minimum Detectable Effects in a statistically significant fashion over a period of weeks. You can then choose a compromise depending on how long you are ready to wait and how small a Lift you wouldn’t want to miss.\u003c/p\u003e\n \u003cp\u003eIn its \u003cstrong\u003epost-test mode\u003c/strong\u003e, it does post hoc results analysis, using power calculations it can predict dynamically how advanced the test currently is.\u003c/p\u003e\n \u003cp\u003eBoth modes support revenue metrics, for pre-test you will need a CSV file with one column of a week’s worth of order values to run MDE calculations for it. For post-test, your CSV needs to have at least 2 columns of order values for the duration of your experiment.\u003c/p\u003e\n "},{"q":"What are Type I vs Type II errors?","a":"\n \u003cp\u003eA \u003cstrong\u003eType I error\u003c/strong\u003e is simply a false positive, for example when the test shows that a variant is a winner but in reality, it’s not. The reason for it is really nothing else than random chance. What you can do is properly “control” the probability of making such an error, let’s say to 5% (in the case of a 95% confidence level) by planning your test properly and sticking to the plan. In other words, you should not look at the results before a certain time or number of samples have been collected.\u003c/p\u003e\n \u003cp\u003e\u003cstrong\u003eIn other words, we dynamically compute the test progress in percentage form based on the effect size at the moment observation, with the desired confidence and power levels targets.\u003c/strong\u003e\u003c/p\u003e\n \u003cp\u003eThe second type of error that can happen are \u003cstrong\u003eType II errors\u003c/strong\u003e. Those are nothing other than false negatives. \n \u003cp\u003eIn reality, there is a change, but it fails to show up at the time that we look at our results and we run away thinking that our variant is under-performing! The way to control this error is to wait for the test to accumulate enough power before assuming that a change is not present! The recommended minimum power level is 80%, but the more the better! Here again, our calculator has a test-progress estimation that will take the desired power level into consideration.\u003c/p\u003e\n \u003cp\u003eWe have written an exhaustive blog on this subject. Check it out \u003ca class=\"MuiTypography-root MuiLink-root MuiLink-underlineHover MuiTypography-colorPrimary\" href=\"https://www.convert.com/blog/optimization/type-i-type-ii-errors-inevitable-in-optimization-experiements/\" target=\"_blank\"\u003ehere\u003c/a\u003e.\u003c/p\u003e\n "}]},"__N_SSG":true},"page":"/","query":{},"buildId":"tJuMa00jOJ37El1M32_Lz","assetPrefix":"/calculator","isFallback":false,"gsp":true}</script><script nomodule="" src="/calculator/_next/static/chunks/polyfills-48bff762178dd7653084.js"></script><script src="/calculator/_next/static/chunks/webpack-39e6b70f465eea5e349d.js" async=""></script><script src="/calculator/_next/static/chunks/framework.2f5e5c03f8dc9a7f3140.js" async=""></script><script src="/calculator/_next/static/chunks/commons.9e018df1d824d805e587.js" async=""></script><script src="/calculator/_next/static/chunks/main-a5f081a83375a3ade490.js" async=""></script><script src="/calculator/_next/static/chunks/51579cad02b770b54ecfac8b5b5991cee3b69909.4e814b495c768b93cf4e.js" async=""></script><script src="/calculator/_next/static/chunks/pages/_app-4319b8bf28080422a675.js" async=""></script><script src="/calculator/_next/static/chunks/29107295.7761e7b5e54036b65dd8.js" async=""></script><script src="/calculator/_next/static/chunks/96a36b26aee9caa5ec60e479e7458ec3246bf7fd.7263dd9f2b4d6476d4d5.js" async=""></script><script src="/calculator/_next/static/chunks/pages/index-70252ecb0625a75363d3.js" async=""></script><script src="/calculator/_next/static/tJuMa00jOJ37El1M32_Lz/_buildManifest.js" async=""></script><script src="/calculator/_next/static/tJuMa00jOJ37El1M32_Lz/_ssgManifest.js" async=""></script></body></html>

Pages: 1 2 3 4 5 6 7 8 9 10