Q: Welcome to Appsumo!
Been looking to add another A/Bn testing platform to my toolbox. Excited to have you here.
Some pressing questions, first. =P
1. Plan — You’ll get this question a lot, so it’d be great to get it in writing on the deal page. Are sumolings linked to the Saas License plan and get all of those future updates? I know you only really have that one plan, but wanted to confirm we’ll get all future updates and features at that level.
2. Load + Implementation — saw it’s a simple line of JS in the header. Great and all, but I’d like to use it on a page-by-page level to decrease load. (Vs unloading the script on a page-by-page level)
3. Wordpress compatibility — Saw you don’t have a WP plugin, which is fine by me. However, do you have confirmed compatibility with the major WP caching plugins? WP Rocket, WP Super Cache, W3, Flyingpress, Asset Cleanup, etc.
4. Page builders — Does this work with common Wordpress page builders, such as Oxygen, Divi, Elementor, Thrive, Beaver, etc. In other words, do you have confirmed compatibility with these?
5. URLs — do different variations have different URLs? Is this required, an option, or not possible? Asking specifically for conversion elements in GA4 and Google Ads.
6. Consecutive flow tests — If yes to #5, can you run consecutive flow tests? For example, let’s say I have an A/Bn test from the home page (if it contains different URLs) with the main conversion element being a visit to the Sales page. Can I also A/Bn test the sales page in this use case and still get reliable data from both tests? (Other A/Bn testing platforms don’t always work well with this)
7. Repeated events — Let’s say a user lands on the home page (where there’s an A/Bn test), navigates away, and comes back to the home page in the same session. Is that counted as multiple events?
8. Event usage report — If we have multiple domains, can you see which ones are using the most events? Can you easily pause one domain from the Web Opt dashboard, or would you have to manually roll the pages back on said domain?
9. Can you create experiments based on outside Javascript? For example, I’ve run A/Bn tests (URL-based) with different social FOMO elements on different pages to see which one converts best. Example, domain.com/home1 has FOMO social product 1 via JS script, domain.com/home2 has FOMO social product 2 via JS script, domain.com/home3 has FOMO social product 3 via JS script, etc.
10. What happens when you run out of events? As in… specifically. There’s been other Saas companies here that have said your page roles back to how it was previously, but didn’t mention their logo would also be there. lol.
MattG_WebtrendsOptimize
May 14, 2024A: Hi,
Hopefully this covers most of your points
1. Yes, all deals are for a SaaS license (i.e. no ongoing services engagements, just the platform usage). This includes all future updates, and typically even where these features are fairly advanced.
2. The suggested implementation is based on what most of our customers do, but you're absolutely welcome to not integrate the tag on pages where you don't want it. The only side-effect is that the platform is unable to do anything on this page, such as run Experiments or track Conversion Goals.
3.Correct, we don't have a plugin yet although it's been requested. From our experience, there are no issues working with WP Caching plugins. Most of them are intended to stop database lookups, and pre-assemble HTML for pages that can therefore be served much faster. As part of this pre-assembled HTML, you'll have our <script> tag, and this will still make "live" calls to our service for content to be swapped out as part of an experiment. So, while your page is cached and includes our Script file, what we do when the page is loaded is not prone to the same caching mechanism.
4. We've yet to come across a front-end interface we can't work with. The principle behind what we do is such that it shouldn't matter. Elementor and Elementor Pro have been tested personally, as parts of our own website are built using it. We'd be extremely surprised if there were issues with others, given we operate in more dynamic environments like React/Angular/Vue apps.
5. No. If you consider the work you do in our UI to be building up a list of "transformations" to make to your page, that probably helps. When your page loads, we run either CSS or JavaScript to modify the page, but don't affect any underlying URLs. We'd be happy to have a conversation to better understand your requirements if you do need it - handling DNS is the primary issue and most clients aren't looking for something that advanced, but we have the ability to run highly performant web pages in our tech stack and so may be willing to work with you and make accomodations.
6. If I understand the question - you could run different sets of transformations on different pages, including transforming one page only if users come from another. These aren't options available in the Visual Editor - they'd be something to set up in the Advanced Editor but certainly possible from a content delivery perspective.
If we were to run a test like this, we'd suggest ensuring there's a dependancy on seeing a previous page. If users could go to Page A without seeing Page B, or Page B without seeing Page A, it's then hard to attribute a lift (pr drop) in conversions to a specific change you're making, which makes the value you gain from experimenting that bit harder to find.
continued ...
7. Yes. Any time we serve content from Optimize, including on repeated visits to the same page, it is considered an Event. We do alternatively measure and bill based on Sessions, in which case it doesn't matter how many tests you run or what a user sees, but that's not a package on offer here with AppSumo.
8. Our normal setup through the AppSumo workflow allows you one Account, through which you can test on a set number of Domains. In this scenario, measurement on a per-domain basis is a challenge, as all of the data sits in one pool and we also have the ability to run cross-domain experiments and tracking.
If required, we could consider modifying your setup and splitting domains you experiment on into different Accounts, as we do with various agencies we work with. In that situation, you'd then have separate tagging, dashboards, experiments, tracking and event usage per domain. If you get into this scenario, feel free to reach out to us and we'll help you out.
As for pausing a domain - we don't have the ability to disable a particular domain easily, but pausing experiments running on particular domains takes 3 or 4 clicks per experiment. If you're only running a handful of experiments, you should be able to pause particular domains in a minute or two. Other mechanisms exist for achieving your end goal of pausing testing - feel free to reach out to us if you end up in this scenario too and we'll happily guide you better than a comments trail here would allow.
9. Your specific scenario looks like a split test might serve it well, which is our most simple to set up. However to answer your question more broadly - we can use the Script sections in our Visual or Advanced Editors to work with 3rd party JS, and do quite often. In the past, we've helped our customers prove/disprove the value of their other SaaS products, we've integrated chat widgets (including into our own UI), served Fit Finder tools for fashion brands, hooked into APIs for car rental websites, etc. - all of which require either writing 3rd party JS to the page or hooking into their APIs. Happy to walk through this in more detail if needed, probably best over a proper conversation.
10. Firstly - never, will we ever, apply transformations to your site other than those you specifically control and set live. We would lose a lot of our clients if we started dropping logos on their websites, and for absolute clarity that will never happen.
We have no hard cut-off in the UI at the minute, and so unlike most other platforms will also not suddenly disable your account.
In the first instance, we'll be in touch to let you know that you're nearing the end of, or have hit the end of your usage. If you'd like to stop there, we'll simply disable your experiences and your tag, and request you remove our tagging too. If you'd like to continue, we'll advise you on how to do so, and request it be handled in a reasonable timeframe. If unsuccessful, we will disable your account. Thanks
AppleJuice500
Verified purchaser
I would like to get answers to these questions too :)
Verified purchaser
NM. Just saw the detailed reply which appeared only after posting a comment. Appsumo comments seem buggy. :D