A/B Test Calculator for Statistical Significance

<!DOCTYPE html> <html class="no-js" dir="ltr" lang="en-US" prefix="og: https://ogp.me/ns#"> <head> <meta charset="UTF-8"> <meta http-equiv="X-UA-Compatible" content="IE=edge"> <meta name="viewport" content="width=device-width, initial-scale=1"> <meta name="facebook-domain-verification" content="zykscnfxq7fozc3u62oxsjhnv2a9kd" /> <meta name="apple-mobile-web-app-title" content="Plerdy"> <link rel="profile" href="https://gmpg.org/xfn/11"> <link rel="shortcut icon" href="/wp-content/themes/twentytwenty/images/favicon/favicon.ico" /> <link rel="icon" type="image/svg+xml" href="/wp-content/themes/twentytwenty/images/favicon/favicon.svg" /> <link rel="icon" type="image/png" href="/wp-content/themes/twentytwenty/images/favicon/favicon-96x96.png" sizes="96x96" /> <link rel="apple-touch-icon" sizes="180x180" href="/wp-content/themes/twentytwenty/images/favicon/apple-touch-icon.png" /> <link rel="apple-touch-icon" sizes="152x152" href="/wp-content/themes/twentytwenty/images/favicon/apple-touch-icon-152x152.png"> <link rel="apple-touch-icon" sizes="120x120" href="/wp-content/themes/twentytwenty/images/favicon/apple-touch-icon-120x120.png"> <link rel="apple-touch-icon" sizes="60x60" href="/wp-content/themes/twentytwenty/images/favicon/apple-touch-icon-60x60.png"> <link rel="apple-touch-icon" sizes="76x76" href="/wp-content/themes/twentytwenty/images/favicon/apple-touch-icon-76x76.png"> <link rel="manifest" href="/wp-content/themes/twentytwenty/images/favicon/site.webmanifest" /> <title>A/B Test Calculator for Statistical Significance – Plerdy</title>  <meta name="description" content="The number of visitors on this page was: The number of overall conversions was: Conversion rate A > 9% B > 12% Your test results Test "B" converted 33..." /> <meta name="robots" content="max-snippet:-1, max-image-preview:large, max-video-preview:-1" /> <link rel="canonical" href="https://www.plerdy.com/a-b-testing-significance-calculator/" /> <meta name="generator" content="All in One SEO Pro (AIOSEO) 4.5.4" /> <meta property="og:locale" content="en_US" /> <meta property="og:site_name" content="Plerdy – tools to improve conversions, usability analysis and SEO." /> <meta property="og:type" content="article" /> <meta property="og:title" content="A/B Test Calculator for Statistical Significance – Plerdy" /> <meta property="og:description" content="The number of visitors on this page was: The number of overall conversions was: Conversion rate A > 9% B > 12% Your test results Test "B" converted 33..." /> <meta property="og:url" content="https://www.plerdy.com/a-b-testing-significance-calculator/" /> <meta property="og:image" content="https://www.plerdy.com/wp-content/uploads/2022/05/B-Testing-Significance-Calculator-min.png" /> <meta property="og:image:secure_url" content="https://www.plerdy.com/wp-content/uploads/2022/05/B-Testing-Significance-Calculator-min.png" /> <meta property="og:image:width" content="1200" /> <meta property="og:image:height" content="630" /> <meta property="article:published_time" content="2023-10-04T14:10:44+00:00" /> <meta property="article:modified_time" content="2025-01-23T08:31:55+00:00" /> <meta name="twitter:card" content="summary" /> <meta name="twitter:title" content="A/B Test Calculator for Statistical Significance – Plerdy" /> <meta name="twitter:description" content="The number of visitors on this page was: The number of overall conversions was: Conversion rate A > 9% B > 12% Your test results Test "B" converted 33..." /> <meta name="twitter:image" content="https://www.plerdy.com/wp-content/uploads/2022/05/B-Testing-Significance-Calculator-min.png" /> <script type="application/ld+json" class="aioseo-schema"> {"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.plerdy.com\/a-b-testing-significance-calculator\/#aioseo-article-lnbutvp4","name":"A\/B Test Calculator for Statistical Significance","headline":"A\/B Test Calculator for Statistical Significance \u2013 Plerdy","description":"In both cases, the specialist must understand what is worth improving and whether the new version will be worse than the previous one. To check their theories, marketers use A\/B-testing. Then they use the A\/B testing significance calculator \u2013 Plerdy","author":{"@type":"Person","name":"sashab","url":"https:\/\/www.plerdy.com\/blog\/author\/sashab\/"},"publisher":{"@id":"https:\/\/www.plerdy.com\/#organization"},"image":{"@type":"ImageObject","url":"https:\/\/www.plerdy.com\/wp-content\/uploads\/2022\/05\/B-Testing-Significance-Calculator-min.png","width":1200,"height":630,"caption":"A\/B Testing Significance Calculator"},"datePublished":"2023-10-04T00:00:00+03:00","dateModified":"2025-01-23T10:31:55+02:00","inLanguage":"en-US","articleSection":"USA"},{"@type":"BreadcrumbList","@id":"https:\/\/www.plerdy.com\/a-b-testing-significance-calculator\/#breadcrumblist","itemListElement":[{"@type":"ListItem","@id":"https:\/\/www.plerdy.com\/#listItem","position":1,"name":"Home","item":"https:\/\/www.plerdy.com\/","nextItem":"https:\/\/www.plerdy.com\/a-b-testing-significance-calculator\/#listItem"},{"@type":"ListItem","@id":"https:\/\/www.plerdy.com\/a-b-testing-significance-calculator\/#listItem","position":2,"name":"A\/B Test Calculator for Statistical Significance","previousItem":"https:\/\/www.plerdy.com\/#listItem"}]},{"@type":"Organization","@id":"https:\/\/www.plerdy.com\/#organization","name":"Plerdy","url":"https:\/\/www.plerdy.com\/"},{"@type":"WebPage","@id":"https:\/\/www.plerdy.com\/a-b-testing-significance-calculator\/#webpage","url":"https:\/\/www.plerdy.com\/a-b-testing-significance-calculator\/","name":"A\/B Test Calculator for Statistical Significance \u2013 Plerdy","description":"The number of visitors on this page was: The number of overall conversions was: Conversion rate A > 9% B > 12% Your test results Test \"B\" converted 33...","inLanguage":"en-US","isPartOf":{"@id":"https:\/\/www.plerdy.com\/#website"},"breadcrumb":{"@id":"https:\/\/www.plerdy.com\/a-b-testing-significance-calculator\/#breadcrumblist"},"image":{"@type":"ImageObject","url":"https:\/\/www.plerdy.com\/wp-content\/uploads\/2022\/05\/B-Testing-Significance-Calculator-min.png","@id":"https:\/\/www.plerdy.com\/a-b-testing-significance-calculator\/#mainImage","width":1200,"height":630,"caption":"A\/B Testing Significance Calculator"},"primaryImageOfPage":{"@id":"https:\/\/www.plerdy.com\/a-b-testing-significance-calculator\/#mainImage"},"datePublished":"2023-10-04T17:10:44+03:00","dateModified":"2025-01-23T10:31:55+02:00"},{"@type":"WebSite","@id":"https:\/\/www.plerdy.com\/#website","url":"https:\/\/www.plerdy.com\/","name":"Plerdy","description":"tools to improve conversions, usability analysis and SEO.","inLanguage":"en-US","publisher":{"@id":"https:\/\/www.plerdy.com\/#organization"}}]} </script>  <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.6.0/jquery.min.js"></script> <style id='classic-theme-styles-inline-css'> /*! This file is auto-generated */ .wp-block-button__link{color:#fff;background-color:#32373c;border-radius:9999px;box-shadow:none;text-decoration:none;padding:calc(.667em + 2px) calc(1.333em + 2px);font-size:1.125em}.wp-block-file__button{background:#32373c;color:#fff;text-decoration:none} </style> <style id='global-styles-inline-css'> body{--wp--preset--color--black: #000000;--wp--preset--color--cyan-bluish-gray: #abb8c3;--wp--preset--color--white: #ffffff;--wp--preset--color--pale-pink: #f78da7;--wp--preset--color--vivid-red: #cf2e2e;--wp--preset--color--luminous-vivid-orange: #ff6900;--wp--preset--color--luminous-vivid-amber: #fcb900;--wp--preset--color--light-green-cyan: #7bdcb5;--wp--preset--color--vivid-green-cyan: #00d084;--wp--preset--color--pale-cyan-blue: #8ed1fc;--wp--preset--color--vivid-cyan-blue: #0693e3;--wp--preset--color--vivid-purple: #9b51e0;--wp--preset--color--accent: #0E77F1;--wp--preset--color--primary: #000000;--wp--preset--color--secondary: #6d6d6d;--wp--preset--color--subtle-background: #dcd7ca;--wp--preset--color--background: #f5efe0;--wp--preset--gradient--vivid-cyan-blue-to-vivid-purple: linear-gradient(135deg,rgba(6,147,227,1) 0%,rgb(155,81,224) 100%);--wp--preset--gradient--light-green-cyan-to-vivid-green-cyan: linear-gradient(135deg,rgb(122,220,180) 0%,rgb(0,208,130) 100%);--wp--preset--gradient--luminous-vivid-amber-to-luminous-vivid-orange: linear-gradient(135deg,rgba(252,185,0,1) 0%,rgba(255,105,0,1) 100%);--wp--preset--gradient--luminous-vivid-orange-to-vivid-red: linear-gradient(135deg,rgba(255,105,0,1) 0%,rgb(207,46,46) 100%);--wp--preset--gradient--very-light-gray-to-cyan-bluish-gray: linear-gradient(135deg,rgb(238,238,238) 0%,rgb(169,184,195) 100%);--wp--preset--gradient--cool-to-warm-spectrum: linear-gradient(135deg,rgb(74,234,220) 0%,rgb(151,120,209) 20%,rgb(207,42,186) 40%,rgb(238,44,130) 60%,rgb(251,105,98) 80%,rgb(254,248,76) 100%);--wp--preset--gradient--blush-light-purple: linear-gradient(135deg,rgb(255,206,236) 0%,rgb(152,150,240) 100%);--wp--preset--gradient--blush-bordeaux: linear-gradient(135deg,rgb(254,205,165) 0%,rgb(254,45,45) 50%,rgb(107,0,62) 100%);--wp--preset--gradient--luminous-dusk: linear-gradient(135deg,rgb(255,203,112) 0%,rgb(199,81,192) 50%,rgb(65,88,208) 100%);--wp--preset--gradient--pale-ocean: linear-gradient(135deg,rgb(255,245,203) 0%,rgb(182,227,212) 50%,rgb(51,167,181) 100%);--wp--preset--gradient--electric-grass: linear-gradient(135deg,rgb(202,248,128) 0%,rgb(113,206,126) 100%);--wp--preset--gradient--midnight: linear-gradient(135deg,rgb(2,3,129) 0%,rgb(40,116,252) 100%);--wp--preset--font-size--small: 18px;--wp--preset--font-size--medium: 20px;--wp--preset--font-size--large: 26.25px;--wp--preset--font-size--x-large: 42px;--wp--preset--font-size--normal: 21px;--wp--preset--font-size--larger: 32px;--wp--preset--spacing--20: 0.44rem;--wp--preset--spacing--30: 0.67rem;--wp--preset--spacing--40: 1rem;--wp--preset--spacing--50: 1.5rem;--wp--preset--spacing--60: 2.25rem;--wp--preset--spacing--70: 3.38rem;--wp--preset--spacing--80: 5.06rem;--wp--preset--shadow--natural: 6px 6px 9px rgba(0, 0, 0, 0.2);--wp--preset--shadow--deep: 12px 12px 50px rgba(0, 0, 0, 0.4);--wp--preset--shadow--sharp: 6px 6px 0px rgba(0, 0, 0, 0.2);--wp--preset--shadow--outlined: 6px 6px 0px -3px rgba(255, 255, 255, 1), 6px 6px rgba(0, 0, 0, 1);--wp--preset--shadow--crisp: 6px 6px 0px rgba(0, 0, 0, 1);}:where(.is-layout-flex){gap: 0.5em;}:where(.is-layout-grid){gap: 0.5em;}body .is-layout-flex{display: flex;}body .is-layout-flex{flex-wrap: wrap;align-items: center;}body .is-layout-flex > *{margin: 0;}body .is-layout-grid{display: grid;}body .is-layout-grid > *{margin: 0;}:where(.wp-block-columns.is-layout-flex){gap: 2em;}:where(.wp-block-columns.is-layout-grid){gap: 2em;}:where(.wp-block-post-template.is-layout-flex){gap: 1.25em;}:where(.wp-block-post-template.is-layout-grid){gap: 1.25em;}.has-black-color{color: var(--wp--preset--color--black) !important;}.has-cyan-bluish-gray-color{color: var(--wp--preset--color--cyan-bluish-gray) !important;}.has-white-color{color: var(--wp--preset--color--white) !important;}.has-pale-pink-color{color: var(--wp--preset--color--pale-pink) !important;}.has-vivid-red-color{color: var(--wp--preset--color--vivid-red) !important;}.has-luminous-vivid-orange-color{color: var(--wp--preset--color--luminous-vivid-orange) !important;}.has-luminous-vivid-amber-color{color: var(--wp--preset--color--luminous-vivid-amber) !important;}.has-light-green-cyan-color{color: var(--wp--preset--color--light-green-cyan) !important;}.has-vivid-green-cyan-color{color: var(--wp--preset--color--vivid-green-cyan) !important;}.has-pale-cyan-blue-color{color: var(--wp--preset--color--pale-cyan-blue) !important;}.has-vivid-cyan-blue-color{color: var(--wp--preset--color--vivid-cyan-blue) !important;}.has-vivid-purple-color{color: var(--wp--preset--color--vivid-purple) !important;}.has-black-background-color{background-color: var(--wp--preset--color--black) !important;}.has-cyan-bluish-gray-background-color{background-color: var(--wp--preset--color--cyan-bluish-gray) !important;}.has-white-background-color{background-color: var(--wp--preset--color--white) !important;}.has-pale-pink-background-color{background-color: var(--wp--preset--color--pale-pink) !important;}.has-vivid-red-background-color{background-color: var(--wp--preset--color--vivid-red) !important;}.has-luminous-vivid-orange-background-color{background-color: var(--wp--preset--color--luminous-vivid-orange) !important;}.has-luminous-vivid-amber-background-color{background-color: var(--wp--preset--color--luminous-vivid-amber) !important;}.has-light-green-cyan-background-color{background-color: var(--wp--preset--color--light-green-cyan) !important;}.has-vivid-green-cyan-background-color{background-color: var(--wp--preset--color--vivid-green-cyan) !important;}.has-pale-cyan-blue-background-color{background-color: var(--wp--preset--color--pale-cyan-blue) !important;}.has-vivid-cyan-blue-background-color{background-color: var(--wp--preset--color--vivid-cyan-blue) !important;}.has-vivid-purple-background-color{background-color: var(--wp--preset--color--vivid-purple) !important;}.has-black-border-color{border-color: var(--wp--preset--color--black) !important;}.has-cyan-bluish-gray-border-color{border-color: var(--wp--preset--color--cyan-bluish-gray) !important;}.has-white-border-color{border-color: var(--wp--preset--color--white) !important;}.has-pale-pink-border-color{border-color: var(--wp--preset--color--pale-pink) !important;}.has-vivid-red-border-color{border-color: var(--wp--preset--color--vivid-red) !important;}.has-luminous-vivid-orange-border-color{border-color: var(--wp--preset--color--luminous-vivid-orange) !important;}.has-luminous-vivid-amber-border-color{border-color: var(--wp--preset--color--luminous-vivid-amber) !important;}.has-light-green-cyan-border-color{border-color: var(--wp--preset--color--light-green-cyan) !important;}.has-vivid-green-cyan-border-color{border-color: var(--wp--preset--color--vivid-green-cyan) !important;}.has-pale-cyan-blue-border-color{border-color: var(--wp--preset--color--pale-cyan-blue) !important;}.has-vivid-cyan-blue-border-color{border-color: var(--wp--preset--color--vivid-cyan-blue) !important;}.has-vivid-purple-border-color{border-color: var(--wp--preset--color--vivid-purple) !important;}.has-vivid-cyan-blue-to-vivid-purple-gradient-background{background: var(--wp--preset--gradient--vivid-cyan-blue-to-vivid-purple) !important;}.has-light-green-cyan-to-vivid-green-cyan-gradient-background{background: var(--wp--preset--gradient--light-green-cyan-to-vivid-green-cyan) !important;}.has-luminous-vivid-amber-to-luminous-vivid-orange-gradient-background{background: var(--wp--preset--gradient--luminous-vivid-amber-to-luminous-vivid-orange) !important;}.has-luminous-vivid-orange-to-vivid-red-gradient-background{background: var(--wp--preset--gradient--luminous-vivid-orange-to-vivid-red) !important;}.has-very-light-gray-to-cyan-bluish-gray-gradient-background{background: var(--wp--preset--gradient--very-light-gray-to-cyan-bluish-gray) !important;}.has-cool-to-warm-spectrum-gradient-background{background: var(--wp--preset--gradient--cool-to-warm-spectrum) !important;}.has-blush-light-purple-gradient-background{background: var(--wp--preset--gradient--blush-light-purple) !important;}.has-blush-bordeaux-gradient-background{background: var(--wp--preset--gradient--blush-bordeaux) !important;}.has-luminous-dusk-gradient-background{background: var(--wp--preset--gradient--luminous-dusk) !important;}.has-pale-ocean-gradient-background{background: var(--wp--preset--gradient--pale-ocean) !important;}.has-electric-grass-gradient-background{background: var(--wp--preset--gradient--electric-grass) !important;}.has-midnight-gradient-background{background: var(--wp--preset--gradient--midnight) !important;}.has-small-font-size{font-size: var(--wp--preset--font-size--small) !important;}.has-medium-font-size{font-size: var(--wp--preset--font-size--medium) !important;}.has-large-font-size{font-size: var(--wp--preset--font-size--large) !important;}.has-x-large-font-size{font-size: var(--wp--preset--font-size--x-large) !important;} .wp-block-navigation a:where(:not(.wp-element-button)){color: inherit;} :where(.wp-block-post-template.is-layout-flex){gap: 1.25em;}:where(.wp-block-post-template.is-layout-grid){gap: 1.25em;} :where(.wp-block-columns.is-layout-flex){gap: 2em;}:where(.wp-block-columns.is-layout-grid){gap: 2em;} .wp-block-pullquote{font-size: 1.5em;line-height: 1.6;} </style> <style id='rocket-lazyload-inline-css'> .rll-youtube-player{position:relative;padding-bottom:56.23%;height:0;overflow:hidden;max-width:100%;}.rll-youtube-player:focus-within{outline: 2px solid currentColor;outline-offset: 5px;}.rll-youtube-player iframe{position:absolute;top:0;left:0;width:100%;height:100%;z-index:100;background:0 0}.rll-youtube-player img{bottom:0;display:block;left:0;margin:auto;max-width:100%;width:100%;position:absolute;right:0;top:0;border:none;height:auto;-webkit-transition:.4s all;-moz-transition:.4s all;transition:.4s all}.rll-youtube-player img:hover{-webkit-filter:brightness(75%)}.rll-youtube-player .play{height:100%;width:100%;left:0;top:0;position:absolute;background:url(https://www.plerdy.com/wp-content/plugins/rocket-lazy-load/assets/img/youtube.png) no-repeat center;background-color: transparent !important;cursor:pointer;border:none;}.wp-embed-responsive .wp-has-aspect-ratio .rll-youtube-player{position:absolute;padding-bottom:0;width:100%;height:100%;top:0;bottom:0;left:0;right:0} </style> <link rel='stylesheet' id='wpo_min-header-0-css' href='https://www.plerdy.com/wp-content/cache/wpo-minify/1742820775/assets/wpo-minify-header-3ad91afc.min.css' media='all' /> <script defer src="https://www.plerdy.com/wp-content/cache/wpo-minify/1742820775/assets/wpo-minify-header-7f750867.min.js" id="wpo_min-header-0-js"></script> <link rel="https://api.w.org/" href="https://www.plerdy.com/wp-json/" /><link rel="alternate" type="application/json" href="https://www.plerdy.com/wp-json/wp/v2/pages/300035911" /><link rel="EditURI" type="application/rsd+xml" title="RSD" href="https://www.plerdy.com/xmlrpc.php?rsd" /> <meta name="generator" content="WordPress 6.5.3" /> <link rel="alternate" type="application/json+oembed" href="https://www.plerdy.com/wp-json/oembed/1.0/embed?url=https%3A%2F%2Fwww.plerdy.com%2Fa-b-testing-significance-calculator%2F" /> <link rel="alternate" type="text/xml+oembed" href="https://www.plerdy.com/wp-json/oembed/1.0/embed?url=https%3A%2F%2Fwww.plerdy.com%2Fa-b-testing-significance-calculator%2F&format=xml" /> <script> document.documentElement.className = document.documentElement.className.replace('no-js', 'js'); </script> <link rel="alternate" hreflang="x-default" href="https://www.plerdy.com/a-b-testing-significance-calculator/" /><noscript><style id="rocket-lazyload-nojs-css">.rll-youtube-player, [data-lazy-src]{display:none !important;}</style></noscript> <script async src="https://www.googletagmanager.com/gtag/js?id=G-15X5JYHSHC"></script> <script> window.dataLayer = window.dataLayer || []; function gtag() { dataLayer.push(arguments); } gtag('js', new Date()); gtag('config', 'G-15X5JYHSHC', { 'send_page_view': false, 'custom_map': { 'dimension1': 'ga_session_id' } }); function setCustomPlerdyVisitorId() { gtag('get', 'G-15X5JYHSHC', 'session_id', function (sessionId) { if (sessionId) { // Send Session ID to GA4 gtag('event', 'set_session_id', { 'ga_session_id': sessionId }); // Send Session ID to Plerdy window.customPlerdyVisitorId = sessionId; console.log('Custom Plerdy Visitor ID:', customPlerdyVisitorId); // Send Page View event after Session ID is set gtag('event', 'page_view'); } else { setTimeout(setCustomPlerdyVisitorId, 500); } }); } setCustomPlerdyVisitorId(); </script> <script type="text/javascript"> var _suid = 278; </script> <script async type="text/javascript" src="https://a.plerdy.com/public/js/click/plerdy_ab.js?v=8bf933f"></script> </head> <body class="page-template page-template-calculator page-template-calculator-php page page-id-300035911 wp-embed-responsive singular enable-search-modal has-post-thumbnail has-no-pagination not-showing-comments show-avatars calculator footer-top-visible" data-language="en" data-support="cookTrue"> <header id="site-header" class="header-footer-group" role="banner"> <span class="bg-scrol-js"></span> <div class="container"> <div class="row_header" id="layoutContainer"> <div class="col_left"> <div class="logo"> <a title="All-in-One Conversion Rate Optimization Platform" href="https://www.plerdy.com/"> <img alt="All-in-One Conversion Rate Optimization Platform" src="/wp-content/themes/twentytwenty/images/icons/plerdy-logo-black.svg"> </a> </div> </div> <div class="burger_menu"> <div class="tras"></div> <button class="burger_btn">Menu</button> <div class="col_center col_center_new--desk"> <div class="menu-%d0%bc%d0%b5%d0%bd%d1%8e-en-container"><ul id="menu-%d0%bc%d0%b5%d0%bd%d1%8e-en" class="menu"><li id="menu-item-70" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-has-children menu-item-70"><a href="#">Products</a><span class="icon"></span> <ul class="sub-menu"> <li id="menu-item-91" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-91"><a href="https://www.plerdy.com/heatmap/">Website Heatmap Tool</a></li> <li id="menu-item-92" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-92"><a href="https://www.plerdy.com/smart-forms/">Pop-Up Software</a></li> <li id="menu-item-104" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-104"><a href="https://www.plerdy.com/seo-alerts/">SEO Checker</a></li> <li id="menu-item-300052142" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-300052142"><a href="https://www.plerdy.com/serp-checker/">SERP Checker</a></li> <li id="menu-item-300055293" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-300055293"><a href="https://www.plerdy.com/ai-ux-assistant/">UX Assistant</a></li> <li id="menu-item-105" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-105"><a href="https://www.plerdy.com/user-session-recordings/">Session Replay Software</a></li> <li id="menu-item-106" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-106"><a href="https://www.plerdy.com/event-goals-tracking/">Event Tracking Tools</a></li> <li id="menu-item-107" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-107"><a href="https://www.plerdy.com/e-commerce-sales-performance/">Ecommerce Analytics</a></li> <li id="menu-item-111" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-111"><a href="https://www.plerdy.com/conversion-funnel/">Website Funnel Analysis</a></li> <li id="menu-item-300056841" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-300056841"><a href="https://www.plerdy.com/ab-testing-tool/">A/B Testing Tool</a></li> <li id="menu-item-200017192" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-200017192"><a href="https://www.plerdy.com/website-feedback-tool/">Website Feedback Tool</a></li> </ul> </li> <li id="menu-item-300043074" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-300043074"><a href="https://www.plerdy.com/pricing/">Pricing & Plans</a></li> <li id="menu-item-73" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-has-children menu-item-73"><a href="#">Learn</a><span class="icon"></span> <ul class="sub-menu"> <li id="menu-item-300029608" class="menu-item menu-item-type-taxonomy menu-item-object-category menu-item-300029608"><a href="https://www.plerdy.com/blog/category/digital-marketing/">Digital marketing</a></li> <li id="menu-item-300055464" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-300055464"><a href="https://www.plerdy.com/blog/category/content-marketing/">Content Marketing</a></li> <li id="menu-item-300029611" class="menu-item menu-item-type-taxonomy menu-item-object-category menu-item-300029611"><a href="https://www.plerdy.com/blog/category/online-sales/">Ecommerce</a></li> <li id="menu-item-300029678" class="menu-item menu-item-type-taxonomy menu-item-object-category menu-item-300029678"><a href="https://www.plerdy.com/blog/category/business/">Business</a></li> <li id="menu-item-300029610" class="menu-item menu-item-type-taxonomy menu-item-object-category menu-item-300029610"><a href="https://www.plerdy.com/blog/category/seo-blog/">SEO</a></li> <li id="menu-item-300055463" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-300055463"><a href="https://www.plerdy.com/blog/category/web-design/">Web Design</a></li> <li id="menu-item-300029679" class="menu-item menu-item-type-taxonomy menu-item-object-category menu-item-300029679"><a href="https://www.plerdy.com/blog/category/seo_service/">Tools</a></li> <li id="menu-item-300029697" class="menu-item menu-item-type-taxonomy menu-item-object-category menu-item-300029697"><a href="https://www.plerdy.com/blog/category/ebooks/">EBooks</a></li> <li id="menu-item-300029680" class="menu-item menu-item-type-taxonomy menu-item-object-category menu-item-300029680"><a href="https://www.plerdy.com/blog/category/google-analytics/">Analytics</a></li> <li id="menu-item-300029612" class="menu-item menu-item-type-taxonomy menu-item-object-category menu-item-300029612"><a href="https://www.plerdy.com/blog/category/guide/">Guide</a></li> <li id="menu-item-300029681" class="menu-item menu-item-type-taxonomy menu-item-object-category menu-item-300029681"><a href="https://www.plerdy.com/blog/category/cases/">Cases</a></li> <li id="menu-item-300055466" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-300055466"><a href="https://www.plerdy.com/blog/category/on-page-seo/">On-page SEO</a></li> <li id="menu-item-300029682" class="menu-item menu-item-type-taxonomy menu-item-object-category menu-item-300029682"><a href="https://www.plerdy.com/blog/category/news/">News</a></li> <li id="menu-item-300029609" class="menu-item menu-item-type-taxonomy menu-item-object-category menu-item-300029609"><a href="https://www.plerdy.com/blog/category/usability/">User Experience (UX)</a></li> <li id="menu-item-300040157" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-300040157"><a href="https://www.plerdy.com/blog/">All Articles</a></li> <li id="menu-item-300022701" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-300022701"><a href="https://www.plerdy.com/usability-testing-website-checklist/">Usability Testing Checklist</a></li> <li id="menu-item-300044672" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-300044672"><a href="https://www.plerdy.com/shopify-checklist/">Shopify Launch Checklist</a></li> <li id="menu-item-300045664" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-300045664"><a href="https://www.plerdy.com/seo-checklist/">SEO Checklist</a></li> <li id="menu-item-300052541" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-300052541"><a href="https://www.plerdy.com/ecommerce-checklist/">Ecommerce Checklist</a></li> <li id="menu-item-300029250" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-300029250"><a href="https://www.plerdy.com/start-ux-game/">UX Game</a></li> <li id="menu-item-300035370" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-300035370"><a href="https://www.plerdy.com/free-tools/">Free tools</a></li> <li id="menu-item-300057921" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-300057921"><a href="https://www.plerdy.com/glossary/">Marketing Glossary</a></li> <li id="menu-item-300059692" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-300059692"><a href="https://www.plerdy.com/google-analytics-4-course/">Google Analytics 4 Course</a></li> <li id="menu-item-300058273" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-300058273"><a href="https://www.plerdy.com/how-to-make-money-with-the-plerdy-affiliate-program/">Affiliate Program</a></li> <li id="menu-item-300040129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-300040129"><a href="https://www.plerdy.com/blog/full-page-screen-capture/">Take a Full-Page Screenshot in Chrome</a></li> <li id="menu-item-300040130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-300040130"><a href="https://www.plerdy.com/website-seo-checker-extension/">Free Chrome Extensions for SEO</a></li> </ul> </li> <li id="menu-item-300038035" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-300038035"><a href="https://www.plerdy.com/book-a-call/">Book a Demo</a></li> </ul></div> <div class="col_right col_right--mob"> <a class="btn btn_blue_txt" target="_blank" href="https://a.plerdy.com/auth/login"> Sign In </a> <a id="try_it_free" class="btn btn_blue" target="_blank" href="https://a.plerdy.com/auth/register"> Try It Free </a> </div> </div> <div class="col_right col_right--desk"> <a class="btn btn_blue_txt" target="_blank" href="https://a.plerdy.com/auth/login"> Sign In </a> <a id="try_it_free" class="btn btn_blue" target="_blank" href="https://a.plerdy.com/auth/register"> Try It Free </a> </div> </div> <script> document.addEventListener("DOMContentLoaded", function () { var burgerBtn = document.querySelector('.burger_btn'); var menuContent = document.querySelector('.burger_menu .col_center'); var body = document.body; if (burgerBtn && menuContent) { burgerBtn.addEventListener('click', function () { var isMenuOpen = burgerBtn.classList.contains('open'); var ancestorElement = document.querySelector(".current-menu-ancestor"); menuContent.style.display = isMenuOpen ? 'none' : 'block'; if (isMenuOpen) { burgerBtn.style.backgroundImage = 'url(/wp-content/themes/twentytwenty/images/menu/mobile_menu.svg)'; burgerBtn.classList.remove('open'); body.classList.remove('no-scroll'); } else { burgerBtn.style.backgroundImage = 'url(/wp-content/themes/twentytwenty/images/menu/Close.svg)'; burgerBtn.classList.add('open'); body.classList.add('no-scroll'); if (ancestorElement && ancestorElement.querySelector(".sub-menu") && !ancestorElement.classList.contains("sub_menu_open")) { ancestorElement.click(); } } }); } }); /* document.addEventListener("DOMContentLoaded", function () { var colRight = document.querySelector('.col_right'); var colCenter = document.querySelector('.col_center'); function moveButtons() { colRight.classList.remove('hidden'); if (window.innerWidth < 767) { if (colRight && colCenter && !colCenter.contains(colRight)) { colCenter.appendChild(colRight); } } else { if (colRight && colCenter.contains(colRight)) { document.querySelector('.burger_menu').appendChild(colRight); } } } moveButtons(); window.addEventListener('resize', moveButtons); }); */ </script> </div> </div> </header> <link rel='stylesheet' href='/wp-content/themes/twentytwenty/assets/css/style_single.css?ver=1.8' media='all' /> <link rel='stylesheet' href='/wp-content/themes/twentytwenty/assets/css/calculator.css?ver=1.8' media='all' /> <link defer="" rel="stylesheet" href="/wp-content/themes/twentytwenty/assets/css/ion.rangeSlider.min.css" type="text/css" media="all"> <section class="main_article "> <script type="text/javascript"> var ajaxurl = "https://www.plerdy.com/wp-admin/admin-ajax.php"; </script> <div class="container"> <div class="row_single"> <div class="wrappet_main"> <div class="sidebar"> <div class="banner_ux banner-use-ab-testing banner-use-ab-testing--desk"> <div class="banner-use-ab-testing__item-1"></div> <div class="banner-use-ab-testing__item-2"> <h4 class="banner-use-ab-testing__title"> Struggling to find what works best on your website? </h4> <p class="banner-use-ab-testing__text"> Missed opportunities and low conversions can cost you big time. </p> <a href="https://a.plerdy.com/auth/register" class="banner-use-ab-testing__link"> Use free A/B testing tool </a> </div> <div class="banner-use-ab-testing__item-3"></div> </div> <div class="sidebar-title sidebar-title-desk">You are here now</div> <div class="sidebar-title sidebar-title-mob">More calculators</div> <div class="active-category"></div> <div class="sidebar-title">More calculators</div> <ul> <li> <a href="https://www.plerdy.com/tiktok-money-calculator/"> <img src="/wp-content/themes/twentytwenty/images/calculator/c_toktok.svg" alt="calculator link" loading="lazy"> <span>TikTok Money Calculator</span> </a> </li> <li> <a href="https://www.plerdy.com/sample-size-calculator/"> <img src="/wp-content/themes/twentytwenty/images/calculator/cal.svg" alt="calculator link" loading="lazy"> <span>Sample Size Calculator</span> </a> </li> <li> <a href="https://www.plerdy.com/cpm-calculator/"> <img src="/wp-content/themes/twentytwenty/images/calculator/c_cpm.svg" alt="calculator link" loading="lazy"> <span>CPM Calculator</span> </a> </li> <li> <a href="https://www.plerdy.com/facebook-ads-cost-calculator/"> <img src="/wp-content/themes/twentytwenty/images/calculator/c_face.svg" alt="calculator link" loading="lazy"> <span>Facebook Ads Cost Calculator</span> </a> </li> <li> <a href="https://www.plerdy.com/romi-calculator/"> <img src="/wp-content/themes/twentytwenty/images/calculator/c_romi.svg" alt="calculator link" loading="lazy"> <span>ROMI Calculator</span> </a> </li> <li> <a href="https://www.plerdy.com/roi-calculator/"> <img src="/wp-content/themes/twentytwenty/images/calculator/c_roi.svg" alt="calculator link" loading="lazy"> <span>ROI Calculator</span> </a> </li> <li> <a href="https://www.plerdy.com/nps-calculator/"> <img src="/wp-content/themes/twentytwenty/images/calculator/c_nps.svg" alt="calculator link" loading="lazy"> <span>NPS calculator</span> </a> </li> <li> <a href="https://www.plerdy.com/ctr-calculator/"> <img src="/wp-content/themes/twentytwenty/images/calculator/c_ctr.svg" alt="calculator link" loading="lazy"> <span>CTR Calculator</span> </a> </li> <li> <a href="https://www.plerdy.com/cac-calculator/"> <img src="/wp-content/themes/twentytwenty/images/calculator/cac_calculator.svg" alt="calculator link" loading="lazy"> <span>CAC Calculator</span> </a> </li> <li> <a href="https://www.plerdy.com/utm-builder/"> <img src="/wp-content/themes/twentytwenty/images/calculator/utm_calculator.svg" alt="calculator link" loading="lazy"> <span>UTM Builder</span> </a> </li> <li> <li> <a href="https://www.plerdy.com/http-header-checker/"> <img src="/wp-content/themes/twentytwenty/images/calculator/window_code.svg" alt="calculator link" loading="lazy"> <span>Http Header Checker</span> </a> </li> <li> <a href="https://www.plerdy.com/youtube-money-calculator/"> <img src="/wp-content/themes/twentytwenty/images/calculator/c_youtube.svg" alt="calculator link" loading="lazy"> <span>YouTube Money Calculator</span> </a> </li> <li> <a href="https://www.plerdy.com/marketing-budget-calculator/"> <img src="/wp-content/themes/twentytwenty/images/calculator/c_marketing.svg" alt="calculator link" loading="lazy"> <span>Marketing Budget Calculator</span> </a> </li> <li> <a href="https://www.plerdy.com/roas-calculator/"> <img src="/wp-content/themes/twentytwenty/images/calculator/c_roas.svg" alt="calculator link" loading="lazy"> <span>ROAS Calculator</span> </a> </li> <li> <a href="https://www.plerdy.com/customer-lifetime-value-calculator/"> <img src="/wp-content/themes/twentytwenty/images/calculator/c_clv.svg" alt="calculator link" loading="lazy"> <span>Customer Lifetime Value Calculator</span> </a> </li> <li> <a href="https://www.plerdy.com/conversion-rate-calculator/"> <img src="/wp-content/themes/twentytwenty/images/calculator/c_conversion.svg" alt="calculator link" loading="lazy"> <span>Conversion Rate Calculator</span> </a> </li> <li> <a href="https://www.plerdy.com/a-b-testing-significance-calculator/"> <img src="/wp-content/themes/twentytwenty/images/calculator/c_ab.svg" alt="calculator link" loading="lazy"> <span>A/B Testing Significance Calculator</span> </a> </li> <li> <a href="https://www.plerdy.com/a-b-split-multivariate-test-duration-calculator/"> <img src="/wp-content/themes/twentytwenty/images/calculator/c_ab_split.svg" alt="calculator link" loading="lazy"> <span>A/B Split & Multivariate Test Duration Calculator</span> </a> </li> <li> <a href="https://www.plerdy.com/web-push-notification-calculator/"> <img src="/wp-content/themes/twentytwenty/images/calculator/c_web.svg" alt="calculator link" loading="lazy"> <span>Web Push Notification Calculator</span> </a> </li> <li> <a href="https://www.plerdy.com/typing-speed-test/"> <img src="/wp-content/themes/twentytwenty/images/calculator/c_typing.svg" alt="calculator link" loading="lazy"> <span>Typing Speed Test</span> </a> </li> <li> <a href="https://www.plerdy.com/online-character-count-tool/"> <img src="/wp-content/themes/twentytwenty/images/calculator/c_keyboard.svg" alt="calculator link" loading="lazy"> <span>Online Character Count Tool</span> </a> </li> <li> <a href="https://www.plerdy.com/password-generator-tool/"> <img src="/wp-content/themes/twentytwenty/images/calculator/password_generator.svg" alt="Strong Password Generator icon" loading="lazy"> <span>Strong Password Generator</span> </a> </li> <li> <a href="https://www.plerdy.com/qr-code-generator/"> <img src="/wp-content/themes/twentytwenty/images/calculator/qr_code_generator.svg" alt="Free QR Code Generator icon" loading="lazy"> <span>Free QR Code Generator</span> </a> </li> <li> <a href="https://www.plerdy.com/ascii-art-generator/"> <img src="/wp-content/themes/twentytwenty/images/calculator/ascii_art_generator.svg" alt="ASCII Art Generator icon" loading="lazy"> <span>ASCII Art Generator</span> </a> </li> <li> <a href="https://www.plerdy.com/meme-generator/"> <img src="/wp-content/themes/twentytwenty/images/calculator/free_meme_generator.svg" alt="Free Meme Generator icon" loading="lazy"> <span>Free Meme Generator</span> </a> </li> <li> <a href="https://www.plerdy.com/share-buttons/"> <img src="/wp-content/themes/twentytwenty/images/calculator/share_buttons_code.svg" alt="Share Buttons Code icon" loading="lazy"> <span>Free Share Buttons Code</span> </a> </li> <li> <a href="https://www.plerdy.com/favicon-generator/"> <img src="/wp-content/themes/twentytwenty/images/calculator/favicon_generator.svg" alt="Favicon Generator icon" loading="lazy"> <span>Favicon Generator</span> </a> </li> <li> <a href="https://www.plerdy.com/robots-txt-generator/"> <img src="/wp-content/themes/twentytwenty/images/calculator/robots_txt_generator.svg" alt="Robots.txt Generator icon" loading="lazy"> <span>Robots.txt Generator</span> </a> </li> <li> <a href="https://www.plerdy.com/meta-description-generator/"> <img src="/wp-content/themes/twentytwenty/images/calculator/meta_description_generator.svg" alt="Meta Description Generator icon" loading="lazy"> <span>Meta Description Generator</span> </a> </li> <li> <a href="https://www.plerdy.com/base64-image-encoder/"> <img src="/wp-content/themes/twentytwenty/images/calculator/base64_image_encoder.svg" alt="Image to Base64 Encoder icon" loading="lazy"> <span>Image to Base64 Encoder</span> </a> </li> <li> <a href="https://www.plerdy.com/base64-image-decoder/"> <img src="/wp-content/themes/twentytwenty/images/calculator/base64_image_decoder.svg" alt="Base64 to Image Decode icon" loading="lazy"> <span>Base64 to Image Decode</span> </a> </li> <li> <a href="https://www.plerdy.com/schema-markup-generator/"> <img src="/wp-content/themes/twentytwenty/images/calculator/schema.svg" alt="Schema Markup Generator icon" loading="lazy"> <span>Schema Markup Generator</span> </a> </li> <li> <a href="https://www.plerdy.com/meta-title-description-checker/"> <img src="/wp-content/themes/twentytwenty/images/calculator/meta_title_description_checker.svg" alt="Meta Title & Description Checker" loading="lazy"> <span>Meta Title & Description Checker</span> </a> </li> <li> <a href="https://www.plerdy.com/h1-checker/"> <img src="/wp-content/themes/twentytwenty/images/calculator/h1_checker.svg" alt="H1 Checker" loading="lazy"> <span>H1 Checker</span> </a> </li> <li> <a href="https://www.plerdy.com/keyword-density-checker/"> <img src="/wp-content/themes/twentytwenty/images/calculator/keyword_density_checker.svg" alt="Keyword Density Checker" loading="lazy"> <span>Keyword Density Checker</span> </a> </li> <li> <a href="https://www.plerdy.com/open-graph-checker/"> <img src="/wp-content/themes/twentytwenty/images/calculator/open_graph_checker.svg" alt="Open Graph Checker" loading="lazy"> <span>Open Graph Checker</span> </a> </li> <li> <a href="https://www.plerdy.com/canonical-tag-checker/"> <img src="/wp-content/themes/twentytwenty/images/calculator/canonical_tag_checker.svg" alt="Canonical Tag Checker" loading="lazy"> <span>Canonical Tag Checker</span> </a> </li> <li> <a href="https://www.plerdy.com/image-alt-tag-checker/"> <img src="/wp-content/themes/twentytwenty/images/calculator/image_alt_tag_checker.svg" alt="Image Alt Tag Checker" loading="lazy"> <span>Image Alt Tag Checker</span> </a> </li> </ul> </div> <main id="site-content"> <article class="category-seo-blog category-usability"> <header class="entry-header has-text-align-center header-footer-group"> <div class="entry-header-inner section-inner medium"> <h1 class="entry-title">A/B Test Calculator for Statistical Significance</h1> </div> </header> <div class="post-inner thin "> <div class="entry-content">   <div class="page-ab-calc"> <div class="inner"> <div class="test-list"> <table class="table"> <thead class="thead"> <tr> <th aria-label="Test ID"></th> <th class="th"><div class="thtitle">The number of visitors <span class="nl">on this page was:</span></div></th> <th class="th"><div class="thtitle">The number of overall <span class="nl">conversions was:</span></div></th> <th aria-label=">"></th> <th class="th">Conversion <span class="nl">rate</span></th> </tr> </thead> <tbody class="tbody"> <tr class="tr"> <td class="td td-id"><span class="td-id-value">A</span></td> <td class="td td-visitors"> <div class="td-value-wrap"><input class="td-value" type="number" min="0" value="1000" aria-label="The number of visitors on this page was:"></div> </td> <td class="td td-conversions"> <div class="td-value-wrap"><input class="td-value" type="number" min="0" value="90" aria-label="The number of overall conversions was:"></div> </td> <td class="td td-gt"><span class="td-gt-value">></span></td> <td class="td td-percent"><span class="td-percent-value">9%</span></td> </tr> <tr class="tr tr-winner"> <td class="td td-id">B</td> <td class="td td-visitors"> <div class="td-value-wrap"><input class="td-value" type="number" min="0" value="1000" aria-label="The number of visitors on this page was:"></div> </td> <td class="td td-conversions"> <div class="td-value-wrap"><input class="td-value" type="number" min="0" value="120" aria-label="The number of overall conversions was:"></div> </td> <td class="td td-gt"><span class="td-gt-value">></span></td> <td class="td td-percent"><span class="td-percent-value">12%</span></td> </tr> </tbody> </table> </div> <div class="test-results"> <p class="results-title">Your test results</p> <p class="results-better"> <span class="results-converted"><strong>Test "B" converted 33% better</strong> than Test "A".</span> <span class="results-certainty">I am <strong>99%</strong> certain that the changes in Test "B" will improve your conversion rate.</span> </p> <p class="results-text">Your A/B test is statistically significant!</p> </div> </div> </div> <div class="banner_ux banner-use-ab-testing banner-use-ab-testing--mob"> <div class="banner-use-ab-testing__item-1"></div> <div class="banner-use-ab-testing__item-2"> <h4 class="banner-use-ab-testing__title"> Struggling to find what works best on your website? </h4> <p class="banner-use-ab-testing__text"> Missed opportunities and low conversions can cost you big time. </p> <a href="https://a.plerdy.com/auth/register" class="banner-use-ab-testing__link"> Use free A/B testing tool </a> </div> <div class="banner-use-ab-testing__item-3"></div> </div> <p>There are only two states in the professional life of a marketer:</p> <ul> <li>Something works, but doesn't bring results - you need to do better.</li> <li>Something works and brings results, but still wants to do better.</li> </ul> <p>In both cases, the specialist must understand what is worth improving and whether the new version will be worse than the previous one. To check their theories, marketers use A/B-testing. Then they use the A/B testing significance calculator.</p> <p>A/B-testing is a marketing method that allows one to check the effectiveness of hypotheses, compare two elements, and choose the most effective one among them. The essence of the test is that users will see different variants of web pages and, accordingly, react to them differently. The variant that shows the best results wins in the end.</p> <p>You can test and improve anything on the website, for example:</p> <ul> <li>Call to action (CTAs)</li> <li>Forms of data collection</li> <li>Illustrations</li> <li>Web page structure</li> <li>Content</li> </ul> <p>You can go through endless variants of what you want to test. The goal of A/B testing is always the same: to increase conversion rates (ideally more sales), click rates, and audience engagement. To achieve any of these, you need to do A/B testing correctly and then use the A/B testing significance calculator.</p> <h2>How to Calculate A/B Testing Significance?</h2> <p> To complete the A/B tests, it is important to understand that the data obtained have been interpreted correctly. This is to make sure that the results are not random.</p> <p>If you skip this step, there is a chance that decisions will have to be made unreasonably. After all, even positive numbers can be misleading. If they are interpreted incorrectly, you run the risk of making unnecessary changes to the site, which will lead to lower conversions.</p> <p>When we perform an A/B test, we create two competing web page versions. And we showed them to two groups of randomly selected people.</p> <p>What is a statistical significance calculator in an A/B test, and why do we need to count it? Results are statistically significant if they are not due to random variation. In other words, you're unlikely to get two different conversion rates for page A and page B unless something specific changes. Statistical significance is a way to make sure your results are reliable before drawing any conclusions. And a calculator helps with this a lot.</p> <p>You need to have confidence in the data before choosing the "winning" option. In statistical A/B testing, results are considered significant if they are not obtained by chance. Thus, achieving statistical significance with a confidence level of 95% means that the results will appear by chance only one time out of 20.</p> <p>Here is an example of calculating statistical significance on a calculator. There are a lot of such calculators - you can choose the most convenient one for you. It's important to understand that whatever calculator you choose, it's important to interpret the results correctly.</p> <p>Let's assume that after completing the A/B test of two web pages, we have the following data:</p> <ul> <li>Page A: traffic 1200 visitors, conversion 2 visitors.</li> <li>Page B: traffic 800 visitors, conversion 10 visitors.</li> </ul> <p>We enter this data into the calculator to see if our results reached statistical significance. It is also important to choose a Confidence Level. This is the approximate value of statistical significance that we think our data has.</p> <p>The result will be:</p> <ul> <li>A conversion - 0,167%</li> <li>B conversion - 1,25%</li> <li>Uplift - 750%</li> <li>P-value - 1,2%</li> <li>Statistical value - 98,2%</li> </ul> <p>Even an A/B test with the high statistical significance that the calculator showed can end up giving false positives. It's best to change things gradually. Optimizing one KPI (conversion) can negatively affect another, such as customer return. You need to keep an eye on all KPIs and avoid the classic importance mistakes.</p> <h2>Analyzing A/B Test Results with Plerdy</h2> <p>Plerdy streamlines the complex process of <a href="https://www.plerdy.com/ab-testing-tool/">analyzing A/B test</a> results. For businesses seeking actionable insights to optimize user experience, Plerdy is the go-to tool. Here’s how to dive deep into the results:</p> <ul> <li><strong>Gather Real-time Data</strong>: With Plerdy, stay on top of your A/B testing metrics. Instant data access ensures you're always clued into your test's progress.</li> <li><strong>Utilize the Calculator Feature</strong>: Crunch numbers with ease and precision. Whether you’re assessing conversion rates or user interactions, Plerdy's calculator helps you make sense of the stats.</li> <li><strong>Pinpoint Winning Variants</strong>: For an e-commerce niche, determine which product layout boosts sales. Or in content marketing, ascertain which headline reels in more readers.</li> <li><strong>Evaluate User Engagement</strong>: For a travel blog, measure which CTA garners more clicks for vacation packages. In tech startups, gauge which app interface increases user retention.</li> <li><strong>Adjust and Iterate</strong>: Based on your findings, tweak your strategies. If an educational portal sees higher enrollment with a particular banner design, it’s time to roll that out.</li> </ul> <p>Harnessing Plerdy's robust functionalities lets businesses effectively decipher their A/B test results. By honing in on what truly resonates with users, it becomes simpler to optimize, adapt, and ultimately thrive in any niche. Dive into Plerdy and unlock unparalleled insights today.</p> <h2>What is a good A/B Testing Significance?</h2> <p>Understanding basic calculations will help you explain why your results are important to those unfamiliar with statistics.</p> <p>The final value of statistical significance, which the calculator calculated in our example, is 98.8%. This is even higher than the initial 95%, so that we can change option B with some confidence.</p> <h2>Conclusion</h2> <p>A/B testing significance calculator is typically used by those who frequently interact with programs and websites. Webmasters, site administrators, SEO specialists, analysts, marketers, and UX researchers need it. It is important to note that you do not need special skills for testing. After testing, you can use a special calculator to determine A/B testing significance.</p> </div> </div> </article> </main> </div> <div class="left_share"> <ul class="share-list" style="display:none;"> <li class="soc_share"> <span></span> </li> <li class="soc_f"> <a target="_blank" href='https://www.facebook.com/sharer.php?u=www.plerdy.com/a-b-testing-significance-calculator/' onclick="ga('send', 'event', 'social', 'fb_share', 'https://www.plerdy.com/a-b-testing-significance-calculator/');"></a> </li> <li class="soc_t"> <a target="_blank" href='https://twitter.com/intent/tweet?url=www.plerdy.com/a-b-testing-significance-calculator/' data-counturl='https://dev.twitter.com/web/tweet-button' onclick="ga('send', 'event', 'social', 'twitter_share', 'https://www.plerdy.com/a-b-testing-significance-calculator/');"> </a> </li> <li class="soc_l"> <a target="_blank" href='https://www.linkedin.com/shareArticle?url=www.plerdy.com/a-b-testing-significance-calculator/' onclick="ga('send', 'event', 'social', 'LinkedIn_share', 'https://www.plerdy.com/a-b-testing-significance-calculator/');"> </a> </li> <li class="soc_d"> <a target="_blank" href='https://bufferapp.com/add?phase=2%20&url=https://www.plerdy.com/a-b-testing-significance-calculator/' onclick="ga('send', 'event', 'social', 'digg', 'https://www.plerdy.com/a-b-testing-significance-calculator/');"> </a> </li> </ul> </div> </div> </div> </section> <script src="/wp-content/themes/twentytwenty/assets/js/ion.rangeSlider.min.js" defer="" type="text/javascript"></script> <footer> <div class="container"> <div class="footer-list"> <div class="footer-list-items"> <span class="footer-list-title">Company</span> <p class="footer-list-item"> <a class="footer-list-link" href="https://www.plerdy.com/about-us/">About Us</a> </p> <p class="footer-list-item"> <a class="footer-list-link" href="https://www.plerdy.com/contact-form/">Contact</a> </p> <p class="footer-list-item"> <a class="footer-list-link" href="https://www.plerdy.com/reviews/">Reviews</a> </p> <p class="footer-list-item"> <a class="footer-list-link" href="https://www.plerdy.com/blog/category/cases/">Case Studies</a> </p> <p class="footer-list-item"> <a class="footer-list-link" href="https://www.plerdy.com/blog/category/ebooks/">Ebooks</a> </p> <p class="footer-list-item"> <a class="footer-list-link" href="https://www.plerdy.com/update/">Updates</a> </p> <p class="footer-list-item"> <a class="footer-list-link" href="https://www.plerdy.com/faq/">FAQ</a> </p> <p class="footer-list-item"> <a class="footer-list-link" href="https://www.plerdy.com/sitemap/">Sitemap</a> </p> <p class="footer-list-item"> <a class="footer-list-link" href="https://www.plerdy.com/what-is-plerdy/">What is Plerdy</a> </p> </div> <div class="footer-list-items"> <span class="footer-list-title">Partner</span> <p class="footer-list-item"> <a class="footer-list-link accent-color-link" href="https://www.plerdy.com/how-to-make-money-with-the-plerdy-affiliate-program/">Affiliate Program</a> </p> <p class="footer-list-item"> <a class="footer-list-link" href="https://www.plerdy.com/partners/">Partnership</a> </p> <p class="footer-list-item"> <a class="footer-list-link" href="https://www.plerdy.com/member-perks/">Bonuses from partners</a> </p> <p class="footer-list-item"> <a class="footer-list-link" href="https://www.plerdy.com/referral-program/">Referral program</a> </p> <p class="footer-list-item"> <a class="footer-list-link" href="https://www.plerdy.com/blog/guest-posting/">Guest posting</a> </p> <p class="footer-list-item"> <a class="footer-list-link" href="https://www.plerdy.com/plugins-for-cms/">CMS Plugins</a> </p> <p class="footer-list-item"> <a class="footer-list-link" href="https://www.plerdy.com/non-profit/">Non-Profits</a> </p> <p class="footer-list-item"> <a class="footer-list-link" href="https://www.plerdy.com/students/">Educators</a> </p> <p class="footer-list-item"> <a class="footer-list-link" href="https://www.plerdy.com/startups/">Startups</a> </p> <p class="footer-list-item"> <a class="footer-list-link" href="https://www.plerdy.com/free-premium-package/">Free Business Package</a> </p> </div> <div class="footer-list-items"> <span class="footer-list-title">Insights</span> <p class="footer-list-item"> <a class="footer-list-link" href="https://www.plerdy.com/user-experience-statistics/">User Experience (UX) Statistics</a> </p> <p class="footer-list-item"> <a class="footer-list-link" href="https://www.plerdy.com/blog/ux-research-process/">UX Research Survey Report</a> </p> <p class="footer-list-item"> <a class="footer-list-link" href="https://www.plerdy.com/website-audit/">How to do a Website Audit</a> </p> </div> <div class="footer-list-items footer-list-items-big"> <span class="footer-list-title">Best of the Best</span> <p class="footer-list-item" style="width: 80%;"> <a class="footer-list-link" href="https://www.plerdy.com/experts/">Top Marketing Experts in the World</a> </p> <p class="footer-list-item"> <a class="footer-list-link" href="https://www.plerdy.com/google-ads-experts/">Google Ads Experts</a> </p> <p class="footer-list-item"> <a class="footer-list-link" href="https://www.plerdy.com/marketing-copywriters/">Marketing Copywriters</a> </p> <p class="footer-list-item"> <a class="footer-list-link" href="https://www.plerdy.com/cmo-experts/">CMO experts</a> </p> <p class="footer-list-item"> <a class="footer-list-link" href="https://www.plerdy.com/cro-experts/">CRO Experts</a> </p> <p class="footer-list-item"> <a class="footer-list-link" href="https://www.plerdy.com/usability-experts/">Usability experts</a> </p> </div> <div class="foot_line"></div> <div class="footer-list-items row_bg_app"> <span class="footer-list-title">Free Tools</span> <a class="footer-list-link g-f" target="_blank" href="https://www.plerdy.com/blog/full-page-screen-capture/">Take a Full-Page Screenshot in Chrome</a> <a class="footer-list-link" target="_blank" href="https://www.plerdy.com/website-seo-checker-extension/">Free Chrome Extensions for SEO</a> </div> <a class="col_support" href="https://war.ukraine.ua/donate/" rel="nofollow"> <i></i> <div> <span>We stand for 🇺🇦 Ukraine.</span> <span>You can find more information and donate here</span> </div> </a> <a class="btn_shopify btn_shopify_centr" href="https://apps.shopify.com/plerdy" target="_blank" rel="nofollow"><span>Find it on the</span>Shopify App Store</a> </div> <div class="foot_lang_soc_pk"> <div class="col_center"> <span class="footer-list-title visib-block">Follow Us:</span> <a class="footer-list-link" href="https://www.youtube.com/channel/UCYA8QdYL8Dsk7xyOso6zxLg" target="_blank"></a> <a class="footer-list-link" href="https://www.linkedin.com/company/plerdy/" target="_blank"></a> <a class="footer-list-link" href="https://www.instagram.com/plerdy_cro_tools/" target="_blank"></a> </div> <div class="wrap_lang"> <ul id="lang"> <li class="lang-item lang-item-2 lang-item-en current-lang lang-item-first"><a lang="en-US" hreflang="en-US" href="https://www.plerdy.com/a-b-testing-significance-calculator/">USA</a></li> <li class="lang-item lang-item-13 lang-item-es no-translation"><a lang="es-ES" hreflang="es-ES" href="https://www.plerdy.com/es/">España</a></li> <li class="lang-item lang-item-5 lang-item-ru no-translation"><a lang="ru-RU" hreflang="ru-RU" href="https://www.plerdy.com/ru/">Казахстан</a></li> <li class="lang-item lang-item-17 lang-item-pl no-translation"><a lang="pl-PL" hreflang="pl-PL" href="https://www.plerdy.com/pl/">Polska</a></li> <li class="lang-item lang-item-21 lang-item-pt no-translation"><a lang="pt-PT" hreflang="pt-PT" href="https://www.plerdy.com/pt/">Portugal</a></li> <li class="lang-item lang-item-9 lang-item-ua no-translation"><a lang="uk" hreflang="uk" href="https://www.plerdy.com/ua/">Україна</a></li> <li class="lang-item lang-item-256632566326231 lang-item-fr no-translation"><a lang="fr-FR" hreflang="fr-FR" href="https://www.plerdy.com/fr/">Français</a></li> </ul> </div> </div> </div> <div class="footer-bottom"> <div class="footer-bottom-content"> <div class="col_right"> <div class="copy" style="line-height: 28px;"> Copyright © 2025. Plerdy. All rights reserved </div> </div> <div class="col_left"> <a class="footer-list-link" href="https://www.plerdy.com/gdpr-plerdy/">GDPR</a> <a class="footer-list-link" href="https://www.plerdy.com/terms-of-service/">Terms of Service</a> <a class="footer-list-link" href="https://www.plerdy.com/do-not-track/">Do Not Track</a> <a class="footer-list-link" href="https://www.plerdy.com/privacy-policy/">Privacy Policy</a> <a class="footer-list-link" href="https://www.plerdy.com/security-policy/">Security Policy</a> </div> </div> </div> </div> <div class="gallery"> <div class="container"> <div class="row"> <div class="col-sm-12"> <div class="popup-gallery mfp-hide popup-gallery-video"></div> </div> </div> </div> </div> <div class="foot_btns_pl foot_btns--mob-post" style="display: none;"> <div class="mob-bootom-links mob-bootom-links--post"> <span class="scroll-top" style="display:inline-block; !important"></span> </div> </div> <script> (function() { var expirationDate = new Date(); expirationDate.setTime( expirationDate.getTime() + 31536000 * 1000 ); document.cookie = "pll_language=en; expires=" + expirationDate.toUTCString() + "; path=/; secure; SameSite=Lax"; }()); </script> <script> /(trident|msie)/i.test(navigator.userAgent)&&document.getElementById&&window.addEventListener&&window.addEventListener("hashchange",function(){var t,e=location.hash.substring(1);/^[A-z0-9_-]+$/.test(e)&&(t=document.getElementById(e))&&(/^(?:a|select|input|button|textarea)$/i.test(t.tagName)||(t.tabIndex=-1),t.focus())},!1); </script> <script>window.lazyLoadOptions = { elements_selector: "iframe[data-lazy-src]", data_src: "lazy-src", data_srcset: "lazy-srcset", data_sizes: "lazy-sizes", class_loading: "lazyloading", class_loaded: "lazyloaded", threshold: 300, callback_loaded: function(element) { if ( element.tagName === "IFRAME" && element.dataset.rocketLazyload == "fitvidscompatible" ) { if (element.classList.contains("lazyloaded") ) { if (typeof window.jQuery != "undefined") { if (jQuery.fn.fitVids) { jQuery(element).parent().fitVids(); } } } } }}; window.addEventListener('LazyLoad::Initialized', function (e) { var lazyLoadInstance = e.detail.instance; if (window.MutationObserver) { var observer = new MutationObserver(function(mutations) { var image_count = 0; var iframe_count = 0; var rocketlazy_count = 0; mutations.forEach(function(mutation) { for (var i = 0; i < mutation.addedNodes.length; i++) { if (typeof mutation.addedNodes[i].getElementsByTagName !== 'function') { continue; } if (typeof mutation.addedNodes[i].getElementsByClassName !== 'function') { continue; } images = mutation.addedNodes[i].getElementsByTagName('img'); is_image = mutation.addedNodes[i].tagName == "IMG"; iframes = mutation.addedNodes[i].getElementsByTagName('iframe'); is_iframe = mutation.addedNodes[i].tagName == "IFRAME"; rocket_lazy = mutation.addedNodes[i].getElementsByClassName('rocket-lazyload'); image_count += images.length; iframe_count += iframes.length; rocketlazy_count += rocket_lazy.length; if(is_image){ image_count += 1; } if(is_iframe){ iframe_count += 1; } } } ); if(image_count > 0 || iframe_count > 0 || rocketlazy_count > 0){ lazyLoadInstance.update(); } } ); var b = document.getElementsByTagName("body")[0]; var config = { childList: true, subtree: true }; observer.observe(b, config); } }, false);</script><script data-no-minify="1" async src="https://www.plerdy.com/wp-content/plugins/rocket-lazy-load/assets/js/16.1/lazyload.min.js"></script><script>function lazyLoadThumb(e,alt){var t='<img src="https://i.ytimg.com/vi/ID/hqdefault.jpg" alt="" width="480" height="360">',a='<button class="play" aria-label="play Youtube video"></button>';t=t.replace('alt=""','alt="'+alt+'"');return t.replace("ID",e)+a}function lazyLoadYoutubeIframe(){var e=document.createElement("iframe"),t="ID?autoplay=1";t+=0===this.parentNode.dataset.query.length?'':'&'+this.parentNode.dataset.query;e.setAttribute("src",t.replace("ID",this.parentNode.dataset.src)),e.setAttribute("frameborder","0"),e.setAttribute("allowfullscreen","1"),e.setAttribute("allow", "accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture"),this.parentNode.parentNode.replaceChild(e,this.parentNode)}document.addEventListener("DOMContentLoaded",function(){var e,t,p,a=document.getElementsByClassName("rll-youtube-player");for(t=0;t<a.length;t++)e=document.createElement("div"),e.setAttribute("data-id",a[t].dataset.id),e.setAttribute("data-query", a[t].dataset.query),e.setAttribute("data-src", a[t].dataset.src),e.innerHTML=lazyLoadThumb(a[t].dataset.id,a[t].dataset.alt),a[t].appendChild(e),p=e.querySelector('.play'),p.onclick=lazyLoadYoutubeIframe});</script> </footer> <div class="row_cookie-bubble"> <div class="cookie-bubble bottom-right"> <div class="cb-wrapper"> <div class="cb-row"> <div class="cb-image true"></div> <div class="cb-row-content"> <span class="message">We use cookies to personalize your experience. By continuing to visit this website you agree to our use of cookies.</span> <div class="cb-controls"> <button class="agreement-btn">Got It</button> <a class="cookie-policy-btn" href="https://www.plerdy.com/privacy-policy/#cookie" target="_blank">Read our cookie Policy</a> </div> </div> </div> </div> </div> </div> <link rel='stylesheet' href='/wp-content/themes/twentytwenty/assets/css/slick.css' media='all' /> <script src="/wp-content/themes/twentytwenty/assets/js/jquery-3.6.0.min.js" defer></script> <script src="/wp-content/themes/twentytwenty/assets/js/slick.js" defer></script> <script src="/wp-content/themes/twentytwenty/assets/js/calc_ab_testing.js" defer></script> <script src="/wp-content/themes/twentytwenty/assets/js/script.js" defer></script> <script src="https://www.plerdy.com/wp-content/themes/twentytwenty/assets/js/plerdy.js?v=1"></script> <script src="/wp-content/themes/twentytwenty/assets/js/use_cases_script.js"></script> </body> </html>

CINXE.COM

A/B Test Calculator for Statistical Significance – Plerdy