Statistical significance

Back to glossary

Statistical significance

Statistical significance is used by market researchers to ensure their findings have not occurred by chance, and are reliable.

For a research finding to be statistically significant, the researcher must show it is at least 95% probable, allowing for an error margin of 5%; this means that if the study was repeated 100 times, a minimum of 95 test results would be the same. In market research, it is highly unlikely that a research study will include all of a target population or be without bias, which makes statistical significance important in demonstrating the reliability of the findings.

To calculate the statistical significance of a finding, the researcher will conduct either a T-test or a Z-test. A T-test assesses whether the findings were a result of chance by checking if two independent groups have the same mean. A Z-test checks the significance of a finding by checking if two independent groups have an equal population proportion. If the tests prove that the mean or proportion are equal, the findings will not be statistically significant.

An important factor that could prevent a finding from being statistically significant is sampling error. Sampling error is when the participants selected for a research study are not representative of the whole target population. In this case, the results will not reflect the whole population correctly, meaning there is no statistical significance.

Why partner with DJS Research?

Senior-led sector experts icon

We build small, director-led, teams of sector experts who are with you from brief to debrief. As an employee-owned company, every one of us is invested in delivering quality, value, and long-term impact.

Research design icon

From agile testing to deep-dive strategic studies, we design research to meet your specific objectives. The agility of our in-house operations team and strength of our UK-wide recruiter network enable seamless execution at scale.

Customer understanding icon

Our sector-focused teams have decades of experience understanding audiences and the complexities of the markets in which our clients operate. Working collaboratively we deliver actionable insight which drives positive change.

We are small enough. We are big enough. We are DJS Research

We'd love to talk...

Contact us today to discuss your next market research project and discover how we could become a valuable extension of your team.

Contact us

Contact us today to discuss your next market research project and discover how we could become a valuable extension of your team.

Contact us