9 MINUTE READ

As a CEO, This Is How You Can Completely Mess Up Research for Your Digital Startup Business

Organizational culture is crucial for startup success; CEO involvement in research, common pitfalls, and solutions are outlined in this insightful article.
Fanni Csincsak
December 6, 2023
What is user experience?

Global Statistics On Startup Failure

75% of startups fail. That’s a fact. This stark reality often stems from management problems and a mismatch between the product and market demand. Surprisingly, these challenges find their roots in organizational culture, persisting despite perks like PTOs, flexible schedules, and a continuous push for employee feedback. It’s a reminder that crafting a resilient organizational culture goes beyond surface-level benefits, impacting the very core of a startup’s success.

Statistics on why startups fail
Statistics on why startups fail

Many of us have encountered the challenge of working with less-than-ideal leaders (fortunately, I’ve also had the privilege of collaborating with exceptional ones). As product designers or UX researchers, we aim to tackle problems and deliver value to our company and end users. Dealing with ineffective leaders can be a daily struggle, leading to burnout with micromanagement and a constant feeling of inadequacy, especially when our goal is to create value and creatively address challenges. Drawing from my own experiences and the narratives I come across, most methodological hiccups in research occur precisely when we directly engage with potential users.

User Research

User research is foundational in understanding the target audience, their needs, and behaviors. Utilizing methodologies such as surveys, analytics, and feedback mechanisms, startups can collect valuable data about user preferences, pain points, and expectations. This process lays the groundwork for informed decision-making throughout the product development lifecycle.

During research tasks, methodological challenges often arise when directly contacting potential users. Two primary techniques employed during these tasks are user interviews and usability tests. User interviews involve in-depth qualitative interactions to understand user feelings, actions, and motivations, while usability tests directly observe user interactions with designs. Both techniques require expert knowledge to avoid skewed results. Expertise is essential in scripting, structuring, employing best practices, and recruiting the right participants to ensure the reliability and effectiveness of these research methods.

User Interviews

In the initial phases of a project, user interviews are essential to gaining qualitative insights from individuals within the target demographic. These interviews aim to understand users’ experiences, needs, pains, motivations, perceptions, and behavior in certain contexts or situations. User interviews are pivotal, specifically in-depth or qualitative interviews with potential users.

Researcher conducting user interview
Researcher conducting user interview

To ensure successful user interviews, following best practices, utilizing well-structured scripts, and selecting appropriate participants are crucial. The interviewer’s behavior plays a pivotal role, impacting the overall quality of results. Experienced professionals excel in navigating nuanced responses, revealing hidden user needs, and fostering a comprehensive understanding. Maintaining a neutral and open-minded demeanor, avoiding leading questions, and building rapport are vital aspects of effective interviewing. Seasoned interviewers adapt their communication style, remain unbiased, and guide participants without imposing preferences.

Usability Tests

Usability tests assess how easily users can interact with a product and accomplish tasks. These tests evaluate the user interface, navigation, and overall user experience. Expert involvement in usability tests is vital as it brings a nuanced understanding of usability principles and methodologies. Experts design effective test scenarios, observe user behavior objectively, and interpret results accurately. Their involvement is crucial in identifying usability issues early on and refining the product iteratively.

Mobile usability test recording
Mobile usability test recording. Source: Emerce

In usability tests, how the facilitator acts affects how users interact with the product. The facilitator’s skill in adjusting how they talk, staying neutral, and gently guiding users without pushing personal opinions really shapes the testing environment. For example, when the facilitator avoids leading questions and doesn’t share personal views, it keeps user feedback genuine. Also, the facilitator’s ability to handle unexpected challenges or confused participants is vital. Being patient, resourceful, and calm when things don’t go as planned saves test sessions and ensures users have a good experience. Following these behavioral principles helps facilitators navigate usability tests well, making the whole testing process more successful and giving us better insights into how users interact with the product.

Common Methodological Issues in User Research

Now that we all know the basics, let’s delve into critical mistakes that can seriously harm your digital startup research:

1. You are creating the product for yourself

Creating a product for yourself may seem like a good idea — you understand the target audience because you’re part of it or have friends. Skipping research, thinking you already have enough data and experience, might be a money-saving move. But, in reality, it’s a money-burning shortcut. Your insights cover only a fraction of the diverse patterns within your audience.

Consider the analogy of trying a French dish. Your initial experience might be unremarkable, but revisiting it in a different context, such as a fine dining restaurant, can make it exceptional. Meanwhile, French individuals at another table might have an entirely different perspective, deeming it their worst experience. This highlights the critical role of diverse demographics and experiences in shaping perceptions.

Food and UX
Image of food. Source: Robb Report

Research is crucial in uncovering these nuanced perspectives, ensuring your product resonates broadly rather than being confined to a limited viewpoint.

2. You take charge of the interviews and test on your own

I’ve seen this happen too often, and it typically ends up as a rather ordinary conversation with a 50–50 participation split. Even if you try to balance it, the lack of experience, proper techniques, and the nuances of conducting interviews become evident. As an experienced researcher, it’s vital to establish a calm and secure environment, reflecting participants’ sentiments and showcasing active listening through both verbal and nonverbal cues.

3. You tell your friends your business idea and then invite them to interviews and tests

While having a vast network of friends, ex-colleagues, and people is beneficial, a potential pitfall arises when these individuals know your deep investment in the startup. Sharing your business idea with friends and involving them in interviews and tests can be beneficial, as can leveraging your network for feedback. However, it’s crucial to recognize that friends might hesitate to provide critical feedback due to social dynamics.

Avoiding discomfort: the "comfort trap"
Avoiding discomfort: the “comfort trap”. Source: WorkLifePsych

Research in social psychology suggests that people, especially within close-knit circles, tend to avoid uncomfortable situations or deliver negative feedback to maintain positive relationships. This phenomenon, known as social desirability bias, can impact the honesty of their responses. Friends, aware of your investment in the startup, may prioritize preserving your feelings over pointing out potential issues. This highlights the importance of seeking diverse and unbiased perspectives to evaluate your product or idea comprehensively.

4. You join the interviews and tests and interrupt them

(Extra points for those who even interrupt the interviews and tests to share their personal experiences with their own products or pitch them to the participant at the beginning or middle of the sessions.)

Joining interviews and tests, particularly if you interrupt or divert the session to discuss personal experiences or pitch the product, can adversely affect the research. Firstly, the presence of an authoritative figure like the CEO can create stress for both the researcher and the participant. Social psychology research indicates that individuals may hesitate to express genuine feelings or concerns when faced with authority figures or individuals associated with the product. This phenomenon, known as social influence, can impact the authenticity of participant responses.

The CEO can create stress for the researcher and the participant by interrupting the session during user research.
The CEO can create stress for the researcher and the participant by interrupting the session during user research.

Moreover, participants may alter their behavior to align with perceived expectations upon discovering your role or connection to the product. Research suggests that individuals often engage in social conformity, adapting their responses to please authority figures or those with a vested interest in the product’s success. This can lead to biased feedback, hindering the identification of genuine user experiences, particularly in usability tests. To mitigate this, maintaining a neutral and unbiased presence during sessions is crucial, fostering an environment where participants can express authentic opinions without fear of disappointing the CEO or associated stakeholders.

5. You start offering advice to the researcher, sharing tips on what they should do and how they should behave during interviews

Imagine being a seasoned entrepreneur with over a decade of experience in building companies. Now, picture hiring a junior team member who, after just two days, begins offering you tips on how to lead your company. Funny?

Ticks & Tricks

Observers

Conducting an in-depth user interview with 10 team members on Zoom might not yield effective results, but tools like Lookback can address these issues by allowing observers to join the interviews and tests. In Lookback, observers see exactly what the moderator sees but remain unheard and unseen. It’s crucial to involve the entire design team, including executives, in user testing despite the potential for biased conclusions. The benefits, such as increased buy-in, enhanced credibility, and a deeper sense of empathy, outweigh the drawbacks.

Lookback has features specifically customized for user interviews and usability tests
Lookback has features specifically customized for user interviews and usability tests. Source: Lookback.

The presence of team members during usability sessions enhances the acceptance of findings, facilitates the implementation of recommendations, and reduces design errors. This recommendation also extends to executives, emphasizing the importance of their participation in prioritizing user experience and securing budget allocations. While acknowledging challenges with partial observations, the overall message underscores the considerable advantages of engaging stakeholders in the user testing process with attention to detail and organizational format.

Use your resources effectively, but be careful with recruitment

Maximize your resource efficiency, but exercise caution in recruitment strategies. While leveraging your network for testing scripts can be valuable, for real interviews or usability tests, consider reaching beyond your network. Seek individuals who are unfamiliar with you and your product but represent potential users for a more objective perspective.

Solve trust issues

Image of a product designer

Address trust concerns by investing in expert product designers or researchers. Hiring motivated professionals skilled in creating profitable solutions adds significant value for both you and the end-users. Entrusting experts with research tasks ensures high-quality outcomes, serving as a solid foundation for making informed strategic decisions, benefiting your business and user experience in the long run.

Conclusions

In conclusion, ensuring research success for a digital startup involves clarifying common pitfalls. The high failure rate of startups underscores the importance of addressing organizational culture issues that transcend superficial perks. Methodological challenges in user research, especially during direct interactions with potential users, can be mitigated by leveraging expert knowledge in scripting, structuring, and participant recruitment. Critical mistakes, such as creating products solely based on personal preferences, conducting interviews alone, involving friends in tests, and exerting undue influence as a CEO during sessions, can seriously hinder the research process. Incorporating observers, including the entire design team and executives, in usability sessions and being strategic in recruitment is crucial to optimize results. Finally, resolving trust issues by investing in expert researchers paves the way for long-term success in making informed business and user experience decisions.

Feel free to contact us if you need further guidance on implementing these principles into your startup’s research endeavors. At Olively, we understand the importance of user-centric approaches and stand ready to collaborate on enhancing your business strategies.

TAGS
CEO
Startup
User Research
Business Success
Contact

Let's create a successful digital product

Get in touch to discuss your product needs. Please fill out the contact form and I’ll get back to you.
Tailored Solutions: Personalized solutions for your unique business challenges using cross-disciplinary expertise.
Responsive Communication: Expect prompt and clear communication every step of the way.
Collaborative Partnership: Co-create innovative solutions through close collaboration.

Get in touch

Thank you!
Your submission has been received.
Oops!
Something went wrong while you were submitting your message.