Message Font: Serif | Sans-Serif
No. of Recommendations: 0

I work in the marketing department for a small net company and we're starting to take a close look at our e-mail tests. Here's the problem:

In running “false tests” where we randomly split a segment of our database into two groups and send them the same e-mail, we are getting click rates that have statistically significant differences between the two groups. My questions are these:

1) Our volumes per cell range from 20K to 500K – what significance test should we be using to read results? (t-test 2 sided, etc)

2) Assuming we are using the correct test for significance, how often should we expect to see “false positives” or “false negatives” in testing?

Print the post  


When Life Gives You Lemons
We all have had hardships and made poor decisions. The important thing is how we respond and grow. Read the story of a Fool who started from nothing, and looks to gain everything.
Contact Us
Contact Customer Service and other Fool departments here.
Work for Fools?
Winner of the Washingtonian great places to work, and Glassdoor #1 Company to Work For 2015! Have access to all of TMF's online and email products for FREE, and be paid for your contributions to TMF! Click the link and start your Fool career.