{"id":8018,"date":"2022-01-13T13:16:18","date_gmt":"2022-01-13T12:16:18","guid":{"rendered":"https:\/\/chapmanbright.com\/?post_type=resources&#038;p=8018"},"modified":"2025-11-17T12:55:43","modified_gmt":"2025-11-17T11:55:43","slug":"a-b-test-everything","status":"publish","type":"resources","link":"https:\/\/chapmanbright.com\/nl\/resources\/guides-tools\/a-b-test-everything\/","title":"A\/B test everything!","content":{"rendered":"","protected":false},"parent":0,"template":"","cb_resources_category":[89],"class_list":["post-8018","resources","type-resources","status-publish","hentry","cb_resources_category-guides-tools"],"acf":{"banner":6011,"title":"A\/B test everything!","text_overview":"We are frequently recommending to our clients to A\/B test their emails and landing pages. This article provides a quick overview of the options for A\/B testing using Marketo Engage.","image":7517,"button":"Read","components":[{"acf_fc_layout":"layout_textblock_full","background":"grey-light","title":"","text":"<em>This article reflects Chapman Bright\u2019s earlier focus on Marketo and 'classical' marketing automation.\r\nToday we help B2B companies scale productivity with automation, AI, and agents. <a href=\"\/services\/pillars\/\">Read more<\/a><\/em>","button":null},{"acf_fc_layout":"layout_textblock_full","background":"none","title":"","text":"At Chapman Bright, we like to talk a lot about best practices. And while these are always a good starting point, you should also remember that every industry and every company will have different experiences.\r\n\r\nAnd that is why we are also frequently recommending to our clients to A\/B test their emails and landing pages. This article provides a quick overview of the options for A\/B testing using Marketo Engage.\r\n<h2><strong>Test one idea at a time<\/strong><\/h2>\r\nAs a quick reminder for those new to A\/B tests, you will only get useful results if you are testing a single change. For example, if you are testing the effectiveness of a button color change, your button color can be the only thing that is different between your two emails. If you also tweak the location of the button\u2026or the text on the button, then the A\/B test will not give you useful data for future improvements.","button":null},{"acf_fc_layout":"layout_textblock_full","background":"grey-light","title":"What can you A\/B test in emails?","text":"There are four different types of A\/B tests you can run within email programs in Marketo. Here are a few options for things you can A\/B test in each category.\r\n<ul>\r\n \t<li>Subject line\r\n<ul>\r\n \t<li>Does including the recipient\u2019s {{lead.First Name}} in the subject line increase open rates?<\/li>\r\n \t<li>Do shorter or longer subject lines perform better?<\/li>\r\n \t<li>Does including your business name in the subject line make a difference?<\/li>\r\n \t<li>Does including emojis make a difference?<\/li>\r\n<\/ul>\r\n<\/li>\r\n \t<li>Whole emails\r\n<ul>\r\n \t<li>Does personalization improve click-through rates? By including names, company name, etc.<\/li>\r\n \t<li>Do shorter emails perform better?<\/li>\r\n \t<li>Does this image banner get more clicks than that image banner? Does this color button get more clicks than that color?<\/li>\r\n<\/ul>\r\n<\/li>\r\n \t<li>From Address\r\n<ul>\r\n \t<li>Does sending from a \u201ccommunications@company.com\u201d email address perform better than a \u201cmarketing@company.com\u201d email address?<\/li>\r\n \t<li>Does sending from a person\u2019s name increase your open rate?<\/li>\r\n \t<li>Does it matter who that person is? Does sending from an account manager or sales person get even better open rates? How about the company CEO?<\/li>\r\n<\/ul>\r\n<\/li>\r\n \t<li>Date\/Time\r\n<ul>\r\n \t<li>Do emails on Mondays perform better than those sent on Thursday?<\/li>\r\n \t<li>Does my target audience work unusual hours? Maybe 4:37AM and 7:09PM are better times to test.<\/li>\r\n \t<li>Does it make a difference if you send at exactly 10:00AM versus 10:04AM?<\/li>\r\n<\/ul>\r\n<\/li>\r\n<\/ul>\r\nAdding an A\/B test to your emails in Marketo is really easy. Within the control panel of your email program, simply click on the \u201cAdd A\/B Test\u201d button and follow the directions with the pop-up window. You can also add an A\/B test to trigger and batch emails, but it is <a href=\"https:\/\/experienceleague.adobe.com\/docs\/marketo\/using\/product-docs\/email-marketing\/general\/functions-in-the-editor\/email-tests-champion-challenger\/champion-challenger-whole-emails.html?lang=en\">a little different<\/a>.\r\n\r\n<img class=\"alignnone wp-image-8023 size-large\" src=\"https:\/\/chapmanbright.com\/wp-content\/uploads\/2021\/12\/AB-Test-Email-1024x791.jpg\" alt=\"\" width=\"1024\" height=\"791\" \/>","button":null},{"acf_fc_layout":"layout_textblock_full","background":"none","title":"What can you A\/B test on landing pages?","text":"In Marketo, there is only one technical requirement for setting up an A\/B test for landing pages, which is having two or more different landing pages. How you make them different is completely up to you. And there is only one measurement of success, which is the conversion rate of how many people filled out the form.\r\n\r\nHere are a few options for things you can A\/B test on your landing pages:\r\n<ul>\r\n \t<li>Images\/Video\r\n<ul>\r\n \t<li>Does having a video on the page increase conversion? Does having the video at the top or the bottom of the page make a difference?<\/li>\r\n \t<li>Does including an image or screenshot of the asset increase conversion? How about a photo of the author\/presenter?<\/li>\r\n \t<li>Does having custom imagery increase conversion? In comparison to a stock photo?<\/li>\r\n<\/ul>\r\n<\/li>\r\n \t<li>Text\r\n<ul>\r\n \t<li>Does changing your landing page text increase conversion?<\/li>\r\n \t<li>Does making the text longer or shorter increase conversion?<\/li>\r\n \t<li>Does changing your primary call to action increase conversion?<\/li>\r\n<\/ul>\r\n<\/li>\r\n \t<li>Forms\r\n<ul>\r\n \t<li>Does reducing the number of fields increase conversion?<\/li>\r\n \t<li>Does making fewer fields mandatory increase conversion?<\/li>\r\n<\/ul>\r\n<\/li>\r\n<\/ul>\r\nTo add an A\/B test to your landing pages, you will first need to create your two (or more) landing pages. While the pages are still <em>unapproved<\/em>, right click on one of them and click \u201cConvert to Test Group\u201d. In your new A\/B test, click on the \u201cTest Group Actions\u201d link and select \u201cEdit Group Members.\u201d You can then find your other unapproved landing page to add it to the test group. After both pages are added to the A\/B test, you can approve the pages and it will start measuring results.\r\n\r\n<img class=\"alignnone size-large wp-image-8027\" src=\"https:\/\/chapmanbright.com\/wp-content\/uploads\/2021\/12\/AB-Test-Landing-Page-1024x508.jpg\" alt=\"\" width=\"1024\" height=\"508\" \/>","button":null},{"acf_fc_layout":"layout_textblock_full","background":"grey-light","title":"Don\u2019t forget about statistical significance","text":"Maybe one of your pages saw a 100% higher conversion rate than your other landing page. That\u2019s great! Except, maybe you only had three conversions total\u2026\r\n\r\nAs you analyze your results, be sure to look at your volume to <a href=\"https:\/\/abtestguide.com\/calc\/\">determine if your results are statistically significant<\/a>. Results are considered statistically significant if there is little likelihood that the variation between A and B occurred by chance.\r\n\r\nOne way to ensure you have enough volume is to organize your A\/B tests into themes over time. Start with all landing pages for three months (or six months) testing the same idea. While the landing pages will all be different and the videos will all be different, you can consistently test if adding a video makes a difference in conversion rates.\r\n\r\nThese results can then feed into your best practices and be implemented as changes within your example programs. And then you can start testing the next idea.","button":null},{"acf_fc_layout":"layout_title","title":"Some extra resource suggestions for you","subtitle":"by our content recommendation engine"},{"acf_fc_layout":"rtp","title":"Some extra resource suggestions for you","categories":["3rdParty","Blog","Case Study","White Paper"],"template":"template1"},{"acf_fc_layout":"layout_form","image":null,"title":"More interesting resources? Subscribe!","form":"<script src=\"\/\/app-nld101.marketo.com\/js\/forms2\/js\/forms2.min.js\"><\/script>\r\n<form id=\"mktoForm_1012\"><\/form>\r\n<script>MktoForms2.loadForm(\"\/\/app-nld101.marketo.com\", \"709-IWW-550\", 1012);<\/script>"},{"acf_fc_layout":"layout_cta","title":"Want to leverage Marketo's A\/B testing functionality?","subtitle":"We can help with your testing strategy!","button":{"title":"Contact","url":"https:\/\/chapmanbright.com\/contact\/","target":""}}]},"acfml_non_translatable_locations":null,"_yoast_wpseo_primary_cb_chaploop_category":null,"_yoast_wpseo_primary_category":null,"_yoast_wpseo_primary_cb_resources_category":"89","_oembed_93c4ee9e07cccdbab2160d89f51e0593":null,"_oembed_time_93c4ee9e07cccdbab2160d89f51e0593":null,"_oembed_895c57a59179d1bdcc0438a6aef65717":null,"_oembed_time_895c57a59179d1bdcc0438a6aef65717":null,"_oembed_a76e0da45bf1cb4c09bc985b193bb36b":null,"_oembed_time_a76e0da45bf1cb4c09bc985b193bb36b":null,"_oembed_d471c06fe0867c32a7c3cd67b5476e72":null,"_oembed_time_d471c06fe0867c32a7c3cd67b5476e72":null,"_oembed_3e251453af4bbbd696536d0acadba70c":null,"_oembed_time_3e251453af4bbbd696536d0acadba70c":null,"_oembed_609a8aa9fc83eb054ff7bc4d33a77773":null,"_oembed_time_609a8aa9fc83eb054ff7bc4d33a77773":null,"_oembed_69e7431aa03b88885898bf8bb28fb3a2":null,"_oembed_time_69e7431aa03b88885898bf8bb28fb3a2":null,"_oembed_1a7070c378b395415af4a19fb20df21e":null,"_oembed_time_1a7070c378b395415af4a19fb20df21e":null,"_oembed_55d4298c0fe3b359fd893e8424afe5ff":null,"_oembed_time_55d4298c0fe3b359fd893e8424afe5ff":null,"_oembed_f9c03bd9872da4d01788e5fab78083b5":null,"_oembed_time_f9c03bd9872da4d01788e5fab78083b5":null,"_oembed_ed31fabb7dfe0fd87fcb196f605adf8a":null,"_oembed_time_ed31fabb7dfe0fd87fcb196f605adf8a":null,"_oembed_f06b7516090267ff536179713f17601d":null,"_oembed_time_f06b7516090267ff536179713f17601d":null,"_oembed_e410f7495d0eaf4554919b3e5f478077":null,"_oembed_72a013d9dd3f2322671bc171fe3158ee":null,"_oembed_940f9a7b80afb0cbcc3ba55ead955b1e":null,"_oembed_06caf10aa2f40e07a7dc241ec9381e32":null,"_oembed_time_06caf10aa2f40e07a7dc241ec9381e32":null,"_oembed_3b19edfaec2ee2d35e9b030ef998c63e":null,"_oembed_time_3b19edfaec2ee2d35e9b030ef998c63e":null,"_oembed_4dbf01cda5d7c2b1d4e613889ea0ea41":null,"_oembed_790b310b2853f889f44a51704e8e43db":null,"_oembed_de0c2f3a9e579d82d9ba59d46c7d6f13":null,"_oembed_time_de0c2f3a9e579d82d9ba59d46c7d6f13":null,"_oembed_f6e83cecc2e9acb7d1ef17990035200a":null,"_oembed_time_f6e83cecc2e9acb7d1ef17990035200a":null,"_oembed_37f9de01864257564c01942ac642dd0a":null,"_oembed_time_37f9de01864257564c01942ac642dd0a":null,"_oembed_bb413565e8d54f815c41cfcbf8544000":null,"_oembed_time_bb413565e8d54f815c41cfcbf8544000":null,"_oembed_01c508667543a073acaa932efa5f40c3":null,"_oembed_time_01c508667543a073acaa932efa5f40c3":null,"_oembed_04cd44f1f3f9be9b6faab34a598e255f":null,"_oembed_time_04cd44f1f3f9be9b6faab34a598e255f":null,"_oembed_df22d986c96061734fee19868cf88af0":null,"_oembed_time_df22d986c96061734fee19868cf88af0":null,"_oembed_e10bab5640f3efd1a065332325fa1451":null,"banner":"3104","_banner":"field_5c7651d015c5c","_title":"field_5c7651d015e12","components":["layout_textblock_full","layout_textblock_full","layout_textblock_full","layout_textblock_full","layout_textblock_full","layout_title","rtp","layout_form","layout_cta"],"_components":"field_5c61508b6fb90","_yoast_wpseo_focuskw":"A\/B Testing","_yoast_wpseo_title":null,"_yoast_wpseo_metadesc":"This article provides a quick overview of the options for A\/B testing using Marketo Engage.","text_overview":"We are frequently recommending to our clients to A\/B test their emails and landing pages. This article provides a quick overview of the options for A\/B testing using Marketo Engage.","_text_overview":"field_5c7651d015fe3","subtitle":null,"_subtitle":null,"logo":null,"_logo":null,"image":"7516","_image":"field_5c7651f47d2e1","button":"Read","_button":"field_5cc848e646b9e","components_4_categories":null,"_components_4_categories":null,"text_intro":null,"_text_intro":null,"frontpage_image":null,"_frontpage_image":null,"event_date_day":null,"_event_date_day":null,"image_link":null,"_image_link":null,"_yoast_wpseo_opengraph-image":null,"_yoast_wpseo_opengraph-image-id":null,"_yoast_wpseo_twitter-image":null,"_yoast_wpseo_twitter-image-id":null,"_yoast_wpseo_opengraph-title":null,"_yoast_wpseo_opengraph-description":null,"_yoast_wpseo_twitter-title":null,"_yoast_wpseo_twitter-description":null,"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>A\/B test everything! - Chapman Bright<\/title>\n<meta name=\"description\" content=\"This article provides a quick overview of the options for A\/B testing using Marketo Engage.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/chapmanbright.com\/nl\/resources\/guides-tools\/a-b-test-everything\/\" \/>\n<meta property=\"og:locale\" content=\"nl_NL\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"A\/B test everything! - Chapman Bright\" \/>\n<meta property=\"og:description\" content=\"This article provides a quick overview of the options for A\/B testing using Marketo Engage.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/chapmanbright.com\/nl\/resources\/guides-tools\/a-b-test-everything\/\" \/>\n<meta property=\"og:site_name\" content=\"Chapman Bright\" \/>\n<meta property=\"article:modified_time\" content=\"2025-11-17T11:55:43+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@chapmanbright\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/chapmanbright.com\/nl\/resources\/guides-tools\/a-b-test-everything\/\",\"url\":\"https:\/\/chapmanbright.com\/nl\/resources\/guides-tools\/a-b-test-everything\/\",\"name\":\"A\/B test everything! - Chapman Bright\",\"isPartOf\":{\"@id\":\"https:\/\/chapmanbright.com\/nl\/#website\"},\"datePublished\":\"2022-01-13T12:16:18+00:00\",\"dateModified\":\"2025-11-17T11:55:43+00:00\",\"description\":\"This article provides a quick overview of the options for A\/B testing using Marketo Engage.\",\"breadcrumb\":{\"@id\":\"https:\/\/chapmanbright.com\/nl\/resources\/guides-tools\/a-b-test-everything\/#breadcrumb\"},\"inLanguage\":\"nl-NL\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/chapmanbright.com\/nl\/resources\/guides-tools\/a-b-test-everything\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/chapmanbright.com\/nl\/resources\/guides-tools\/a-b-test-everything\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/chapmanbright.com\/nl\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Resources\",\"item\":\"https:\/\/chapmanbright.com\/nl\/resources\/%resource%\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"A\/B test everything!\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/chapmanbright.com\/nl\/#website\",\"url\":\"https:\/\/chapmanbright.com\/nl\/\",\"name\":\"Chapman Bright\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/chapmanbright.com\/nl\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/chapmanbright.com\/nl\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"nl-NL\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/chapmanbright.com\/nl\/#organization\",\"name\":\"Chapman Bright\",\"url\":\"https:\/\/chapmanbright.com\/nl\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"nl-NL\",\"@id\":\"https:\/\/chapmanbright.com\/nl\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/chapmanbright.com\/wp-content\/uploads\/2019\/03\/logo_chapmanbright_colour_RGB.png\",\"contentUrl\":\"https:\/\/chapmanbright.com\/wp-content\/uploads\/2019\/03\/logo_chapmanbright_colour_RGB.png\",\"width\":2000,\"height\":338,\"caption\":\"Chapman Bright\"},\"image\":{\"@id\":\"https:\/\/chapmanbright.com\/nl\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/x.com\/chapmanbright\",\"https:\/\/www.linkedin.com\/company\/chapman-bright\/\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"A\/B test everything! - Chapman Bright","description":"This article provides a quick overview of the options for A\/B testing using Marketo Engage.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/chapmanbright.com\/nl\/resources\/guides-tools\/a-b-test-everything\/","og_locale":"nl_NL","og_type":"article","og_title":"A\/B test everything! - Chapman Bright","og_description":"This article provides a quick overview of the options for A\/B testing using Marketo Engage.","og_url":"https:\/\/chapmanbright.com\/nl\/resources\/guides-tools\/a-b-test-everything\/","og_site_name":"Chapman Bright","article_modified_time":"2025-11-17T11:55:43+00:00","twitter_card":"summary_large_image","twitter_site":"@chapmanbright","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/chapmanbright.com\/nl\/resources\/guides-tools\/a-b-test-everything\/","url":"https:\/\/chapmanbright.com\/nl\/resources\/guides-tools\/a-b-test-everything\/","name":"A\/B test everything! - Chapman Bright","isPartOf":{"@id":"https:\/\/chapmanbright.com\/nl\/#website"},"datePublished":"2022-01-13T12:16:18+00:00","dateModified":"2025-11-17T11:55:43+00:00","description":"This article provides a quick overview of the options for A\/B testing using Marketo Engage.","breadcrumb":{"@id":"https:\/\/chapmanbright.com\/nl\/resources\/guides-tools\/a-b-test-everything\/#breadcrumb"},"inLanguage":"nl-NL","potentialAction":[{"@type":"ReadAction","target":["https:\/\/chapmanbright.com\/nl\/resources\/guides-tools\/a-b-test-everything\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/chapmanbright.com\/nl\/resources\/guides-tools\/a-b-test-everything\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/chapmanbright.com\/nl\/"},{"@type":"ListItem","position":2,"name":"Resources","item":"https:\/\/chapmanbright.com\/nl\/resources\/%resource%\/"},{"@type":"ListItem","position":3,"name":"A\/B test everything!"}]},{"@type":"WebSite","@id":"https:\/\/chapmanbright.com\/nl\/#website","url":"https:\/\/chapmanbright.com\/nl\/","name":"Chapman Bright","description":"","publisher":{"@id":"https:\/\/chapmanbright.com\/nl\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/chapmanbright.com\/nl\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"nl-NL"},{"@type":"Organization","@id":"https:\/\/chapmanbright.com\/nl\/#organization","name":"Chapman Bright","url":"https:\/\/chapmanbright.com\/nl\/","logo":{"@type":"ImageObject","inLanguage":"nl-NL","@id":"https:\/\/chapmanbright.com\/nl\/#\/schema\/logo\/image\/","url":"https:\/\/chapmanbright.com\/wp-content\/uploads\/2019\/03\/logo_chapmanbright_colour_RGB.png","contentUrl":"https:\/\/chapmanbright.com\/wp-content\/uploads\/2019\/03\/logo_chapmanbright_colour_RGB.png","width":2000,"height":338,"caption":"Chapman Bright"},"image":{"@id":"https:\/\/chapmanbright.com\/nl\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/chapmanbright","https:\/\/www.linkedin.com\/company\/chapman-bright\/"]}]}},"_links":{"self":[{"href":"https:\/\/chapmanbright.com\/nl\/wp-json\/wp\/v2\/resources\/8018","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/chapmanbright.com\/nl\/wp-json\/wp\/v2\/resources"}],"about":[{"href":"https:\/\/chapmanbright.com\/nl\/wp-json\/wp\/v2\/types\/resources"}],"wp:attachment":[{"href":"https:\/\/chapmanbright.com\/nl\/wp-json\/wp\/v2\/media?parent=8018"}],"wp:term":[{"taxonomy":"cb_resources_category","embeddable":true,"href":"https:\/\/chapmanbright.com\/nl\/wp-json\/wp\/v2\/cb_resources_category?post=8018"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}