What is your favorite research method? Under what circumstances do you feel it's best applied? What are the pros and cons of using this methodology?

Question

Anonymous · Accepted Answer

"My favorite research method is A/B testing, especially when evaluating specific
features or design elements in a product to understand their impact on user
behavior. A/B testing is ideal when we want to determine the effectiveness of a
change by directly comparing two or more versions of an experience. It’s best
applied when we have a clear hypothesis, measurable outcomes, and a large enough
sample to achieve statistical significance.
Pros: One major advantage of A/B testing is that it provides clear, actionable
insights by isolating variables. This helps determine causation rather than just
correlation, which is valuable for making confident, data-backed decisions.
Additionally, A/B testing is highly iterative, allowing teams to continuously
optimize features based on real user feedback in real-time environments.
Cons: However, A/B testing does have limitations. It requires a significant user
base to achieve statistical significance, which may not be feasible for niche
products or low-traffic features. Also, it can be narrow in scope—testing one
variable at a time often doesn’t capture the complexity of user experiences
where multiple factors interact. Finally, if not designed carefully, A/B tests
can introduce biases or fail to account for confounding variables, leading to
misleading results.

Anonymous · Answer

My favourite research method is user interviews. The circumstance it would be
best applied in is the discovery phase of a product. When you are trying to gain
as much insight into the users and the context of where and how they would use
the product. The pros of using this methodology, is since it is generative in
nature, you gain a lot of rich data on the users and the context of the product
use. This research method can be unstructured giving the interviewer complete
freedom on how the interview is shaped or semi structured, giving the
interviewer more control in the questions asked and the insights discovered. A
con of using this methodology is that since it is generative in nature, unless
the interviewer is focused, the interview can get away from them, leading to an
information dump from the user. This could lead to waste of time and a lot of
unrelevant data.

Anonymous · Answer

One of my favourite research methods is A/B testing. It was a method I used
often in my previous role. At that time, we were designing a completely new tool
for our stakeholders, and there was a lot of ambiguity with requirements and
features. This method allowed us to try and test various designs and layouts,
and get feedback, which we then leveraged to streamline our layouts and designs

Anonymous · Answer

My favorite research method is the one that fit the research goals the best. For
example, some questions need qualitative research, some quantitative, some data
analysis. Also it should be realistic and feasible, if team doesn't have time or
resources to run longitudinal study I should offer second best option
considering the deadline.

Anonymous · Answer

I really think my favorite research method is based on whatever suits the needs
of the project I am working on so its hard to answer that. If I had to choose
one method it would be user interviews as you can gain a lot of insight or
context into how users behave the way they do and what causes them to make
certain decisions. Although, you have to be careful because you are dealing with
a smaller sample size and its not fully representative of all users. it is also
very expensive and time consuming so it's important to only use it when you want
to understand the root of a question or problem

What is your favorite research method? Under what circumstances do you feel it's best applied? What are the pros and cons of using this methodology?

Practice this question with AI

Go Premium

Community Answers

Unlock Full Access

Unlock Full Access

Unlock Full Access

Unlock Full Access

Unlock Full Access

Practice More Questions