Metrics question
How would you test the LinkedIn feature "People you may know" when you don't have any data to base your decision off of?
- Metrics
- Hard
Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.
Start a mock interview on this question · Mock interview from a job description
What this question tests
Ability to design an evaluation methodology for a recommendation feature before any usage data exists, using proxies and qualitative methods.
How to approach it
- Clarify 'no data' as no historical usage data on this specific feature, though LinkedIn has plenty of graph data to power the recommendations.
- Start with offline evaluation: hold out already-formed connections and test whether the algorithm would have recommended them, precision and recall against known ground truth.
- Run a small qualitative test: show recommendations to a sample of users and ask them to rate relevance directly, since click history doesn't exist yet.
- Launch a limited pilot at a small percent rollout to start generating real behavioral data before a full launch.
- Define the metrics you'll graduate to once data exists: connection-request rate, acceptance rate, and downstream engagement from new connections.
What a strong answer includes
- Separates offline evaluation using existing graph data from online evaluation needing live data, showing you're not starting from zero.
- Proposes a concrete qualitative relevance-rating method to substitute for missing click data early on.
- Defines the metrics graph you'd move to once the pilot generates real data.
Common mistakes
- Assuming no data means no way to evaluate at all, rather than using existing graph data as an offline proxy.
- Jumping straight to a full launch without a staged pilot to generate real behavioral data safely.
Likely follow-up questions
- How would you avoid the recommendations feeling creepy or invasive during this test?
- What would be your rollout plan from pilot to full launch?
More metrics questions
- Consider there is a company say LinkedIn. Which are the top three metrics you would see first thing in the morning?PayPal · Metrics · Easy
- What metrics would you look at to evaluate LinkedIn's success?LinkedIn · Metrics · Medium
- You are a PM for LinkedIn Trust Team. A number of senior influencers at LinkedIn have complained that they receive innumerable spam connection requests and they threaten to leave the platform or launch a tirade against LinkedIn. What do you do?Amazon · Metrics · Hard
- Pick a feature from a product of your choice & tell us how will you assess the success of that feature. Assume it is being launched now.Google · Metrics · Medium
- LinkedIn has introduced a new feature for job applicants called the ‘Match Calculator.’ This feature allows users to click on a job post and see a percentage indicating how well their profile matches the job description. How would you measure its success?LinkedIn · Metrics · Medium
- LinkedIn’s engagement is falling by 10% day over day. What would you do?LinkedIn · Metrics · Hard
More questions from LinkedIn
Learn the skill behind it
Chapters of the AI PM course that teach what this question tests.
- Chapter 9: Prove it paid off: outcomes, economics, and pricing
- Chapter 2: Data fluency: SQL, logs, and reading the truth yourself
- Chapter 14: Get the job: the AI PM interview loop