Walmart Business Analyst Interview Questions (2026)

Online coding test -> 2-3 technical rounds (DSA, system design) -> hiring manager

1. Q1

   Design an A/B test for a new Walmart App ranking or recommendation change. Define hypothesis, primary metric, guardrails, randomization unit, and launch decision rule

   MediumStatistics & Experimentation RoundA/B TestingWalmart-specific

   Context: Context: Walmart wants to grow omnichannel adoption while keeping fulfillment reliable and inventory visible.

   How to answer: A strong answer will define a clear, testable hypothesis for the app change (e.g., 'The new algorithm will increase conversion rate'). It will identify a primary metric directly tied to the hypothesis, such as 'add-to-cart rate' or 'purchase conversion rate,' and establish relevant guardrail metrics like 'app crashes' or 'page load time' to monitor negative impacts. The randomization unit should be clearly defined, typically 'user ID' or 'device ID,' to ensure consistent experience. Finally, a robust launch decision rule based on statistical significance (e.g., 'p-value < 0.05 on primary metric, no negative impact on guardrails') will be presented.

2. Q2

   For Walmart+, should randomization happen at customer, session, device, marketplace seller, or market level? Explain the tradeoffs

   MediumStatistics & Experimentation RoundA/B TestingWalmart-specific

   Context: Consider cross-device behavior, interference, marketplace effects, and operational feasibility.

   How to answer: Randomization for Walmart+ should primarily happen at the customer level to ensure independent observations and avoid contamination, as customer behavior is the key metric. Session or device level randomization could lead to a single customer experiencing both A and B versions, confounding results. Marketplace seller or market level randomization is generally too broad for a subscription service like Walmart+, potentially introducing significant variance due to external factors and requiring a much larger sample size and longer test duration to detect effects.

3. Q3

   Choose primary and guardrail metrics for a Online Grocery experiment aimed at improving digital-to-store conversion. What metrics would prevent a harmful launch?

   MediumStatistics & Experimentation RoundA/B TestingWalmart-specific

   Context: Include user experience, partner health, revenue, reliability, and long-term retention considerations.

   How to answer: For an Online Grocery experiment focused on improving digital-to-store conversion, the primary metric should directly measure the conversion from online engagement (e.g., viewing an item, adding to cart) to an in-store action (e.g., pickup, purchase). A strong primary metric would be 'Digital-to-Store Conversion Rate' (e.g., users who viewed an item online and then picked it up or purchased it in-store within X days). Guardrail metrics are crucial to prevent negative impacts. Key guardrails would include 'Average Order Value (AOV)' for both online and in-store, 'Customer Satisfaction Score (CSAT)' or 'Net Promoter Score (NPS)', and 'Return Rate' for in-store purchases to ensure the experiment doesn't drive low-quality conversions or customer frustration.

4. Q4

   During a Marketplace experiment, the treatment/control split is 52/48 instead of 50/50. How would you diagnose sample ratio mismatch?

   MediumStatistics & Experimentation RoundA/B TestingWalmart-specific

   Context: Assume assignment logs, exposure logs, and eligibility filters may disagree.

   How to answer: First, verify the SRM using a chi-squared test on the observed counts to confirm statistical significance. Then, investigate the randomization unit (e.g., user, session, item) and ensure consistent implementation across both groups. Next, check for any pre-experiment filters or post-experiment data exclusions that might disproportionately affect one group. Finally, review the experiment setup and deployment logs for potential bugs in the assignment logic or traffic allocation system.

5. Q5

   The Store Pickup experiment is trending positive after two days. A PM wants to stop early and launch. How do you handle peeking and sequential testing?

   MediumStatistics & Experimentation RoundA/B TestingWalmart-specific

   Context: Discuss pre-specified stopping rules, alpha spending, business urgency, and risk.

   How to answer: A strong candidate would first explain that peeking early at A/B test results can lead to false positives and inflate Type I error rates, making the experiment invalid. They would then discuss the importance of pre-determining sample size and test duration based on statistical power, minimum detectable effect, and significance level. The candidate should advocate for letting the experiment run its full course to achieve statistical validity, unless there's a strong negative trend requiring an early stop for business reasons. Finally, they would mention sequential testing as an advanced method that allows for valid early stopping, but requires specific statistical adjustments (e.g., using alpha-spending functions) that are unlikely to have been implemented for a standard two-day peek.

6. Q6

   A new Retail Media feature shows a large week-1 lift in digital-to-store conversion, but the effect fades by week 4. What could explain this and how would you design the test duration?

   MediumStatistics & Experimentation RoundA/B TestingWalmart-specific

   Context: Discuss novelty, learning effects, seasonality, and durable impact.

   How to answer: The fading lift could be due to novelty effect, where initial user engagement is high for a new feature but normalizes over time as it becomes less novel. Another explanation is seasonality or external factors that influenced week 1 differently than subsequent weeks, or a 'power user' effect where early adopters quickly integrate the feature, but broader adoption is slower or less impactful. To design the test duration, I would recommend a minimum of 4-6 weeks to observe stabilization beyond initial novelty, ensuring it covers at least one full purchase cycle for the relevant product categories. I would also consider A/B testing for longer durations (e.g., 8-12 weeks) if the product has a longer sales cycle or if there are known weekly/monthly cyclical patterns in customer behavior.

7. Q7

   In a marketplace-like Walmart App feature, treatment users may affect control users. How would network effects or interference bias the experiment?

   MediumStatistics & Experimentation RoundA/B TestingWalmart-specific

   Context: Examples include marketplace seller supply, content inventory, delivery capacity, or pricing pressure.

   How to answer: Network effects or interference bias an A/B test by violating the core assumption of independent user behavior between control and treatment groups. This leads to an inaccurate measurement of the treatment's true impact, as the control group's behavior is influenced by the treatment group's actions (or vice-versa). Specifically, negative network effects might make the treatment appear worse than it is, while positive network effects could inflate its perceived benefit. This invalidates direct comparison and makes it difficult to determine causality.

8. Q8

   digital-to-store conversion is a low-frequency event for Walmart+. How would you set up an experiment with enough power without waiting too long?

   MediumStatistics & Experimentation RoundA/B TestingWalmart-specific

   Context: Discuss proxy metrics, variance reduction, larger samples, longer windows, and risk of metric gaming.

   How to answer: To experiment with low-frequency digital-to-store conversion for Walmart+ without waiting too long, I would first define a clear, measurable proxy metric that is a high-frequency precursor to the conversion, such as 'adding a store-specific item to cart' or 'viewing store inventory details'. I would then design an A/B test around this proxy metric, ensuring a sufficiently large sample size and a clear hypothesis. To further accelerate, I would consider a sequential testing approach or a multi-armed bandit strategy if the goal is optimization rather than pure causal inference, allowing for earlier stopping or adaptation.

9. Q9

   Design a geo or market-level experiment for Online Grocery. When is this better than user-level randomization, and what are the analytical downsides?

   MediumStatistics & Experimentation RoundA/B TestingWalmart-specific

   Context: Use matched markets, pre-period balancing, spillover checks, and fewer experimental units.

   How to answer: A strong candidate would design a geo-level experiment by selecting distinct geographic markets (e.g., cities, DMAs) for treatment and control groups, ensuring they are comparable in size, demographics, and historical performance. This approach is superior to user-level randomization when there are network effects, spillover effects, or when the intervention fundamentally alters the market (e.g., pricing changes, new fulfillment models). Analytical downsides include lower statistical power due to fewer experimental units, increased variance, and the challenge of finding truly isolated and comparable geos, potentially leading to selection bias and confounding factors.

10. Q10

    The Marketplace experiment lifts digital-to-store conversion overall, but only for new users and only in one category. How would you evaluate heterogeneous treatment effects?

    HardStatistics & Experimentation RoundA/B TestingWalmart-specific

    Context: Balance pre-planned segments with exploratory slicing and multiple testing risk.

    How to answer: A strong candidate would first identify the need for subgroup analysis, specifically segmenting by user type (new vs. existing) and product category. They would then propose statistical methods to test for significant differences in treatment effects across these subgroups, such as interaction terms in regression models or difference-in-differences for specific segments. The answer should also cover the importance of power analysis for these subgroups and the potential for false positives when conducting multiple comparisons. Finally, they would discuss how these findings inform targeted rollout strategies or further experimentation.

11. Q11

    Treatment improves digital-to-store conversion but worsens substitution and pickup delay rate for Store Pickup. Walk through a launch recommendation

    HardStatistics & Experimentation RoundA/B TestingWalmart-specific

    Context: Make a decision under conflicting metrics and quantify tradeoffs for stakeholders.

    How to answer: A strong recommendation requires quantifying the trade-offs. First, calculate the monetary value of the digital-to-store conversion uplift versus the costs associated with increased substitution and pickup delay. Consider segmenting the analysis by customer type or store characteristics to identify specific impact areas. Propose a phased rollout strategy, starting with stores or regions where the net benefit is positive, and include a plan for further iteration and mitigation of negative impacts.

12. Q12

    How would you design ramp-up, holdback, and post-launch monitoring for a successful Retail Media A/B test?

    HardStatistics & Experimentation RoundA/B TestingWalmart-specific

    Context: Include ramp stages, persistent holdback, alert thresholds, rollback criteria, and owner accountability.

    How to answer: Design ramp-up by gradually exposing a small percentage of eligible ad impressions or users to the new experience, closely monitoring key metrics like ad impressions, clicks, and revenue, alongside system health and error rates. Implement a holdback group (e.g., 5-10% of the control group) that never sees the new feature, even post-launch, to measure long-term novelty effects and ensure sustained uplift. Post-launch monitoring involves continuous tracking of primary and secondary metrics, setting up automated alerts for significant deviations, and conducting periodic deep-dive analyses to detect subtle shifts, seasonality, or interaction effects with other features.

13. Q13

    Midway through the Walmart App test, tracking for Online Grocery changed. How would you decide whether the experiment results are still usable?

    HardStatistics & Experimentation RoundA/B TestingWalmart-specific

    Context: Compare instrumentation versions, affected traffic share, raw logs, and sensitivity analyses.

    How to answer: First, identify the exact nature and timing of the tracking change relative to the experiment's start and the change point. Analyze the impact on key Online Grocery metrics (e.g., conversion, basket size) for both control and treatment groups before and after the change. If the change introduced a systematic bias affecting one group disproportionately or altered the metric definition, the results are likely compromised. Consider segmenting the data to analyze pre-change and post-change periods separately, or if the impact is minimal and symmetrical across groups, assess if the core experiment hypothesis remains testable.

14. Q14

    Two overlapping experiments on Walmart+ both affect gross margin dollars. How would you detect and manage interaction effects?

    HardStatistics & Experimentation RoundA/B TestingWalmart-specific

    Context: Discuss experiment registry, factorial design, exclusion rules, and interaction terms.

    How to answer: To detect interaction effects between two overlapping A/B tests affecting gross margin, I would first ensure proper experimental design, ideally using a factorial design if possible, or at least clearly defining the overlapping user segments. I would then analyze the gross margin impact in each experiment's control and treatment groups, and critically, in the intersection group (users exposed to both treatments) compared to a baseline (users exposed to neither or only one control). Statistical methods like ANOVA or regression analysis, including an interaction term, would be used to quantify the significance and magnitude of any combined effect differing from the sum of individual effects. If significant interactions are found, I would prioritize understanding the causal mechanism and recommend either sequential rollout, targeted user segmentation, or a combined treatment rollout after further validation.

15. Q15

    Walmart's Walmart App revenue suddenly drops 10% week over week. Structure a business case to diagnose the issue and identify the most likely drivers

    MediumProduct Analytics & Business CaseBusiness CasesWalmart-specific

    Context: Consider traffic, conversion, pricing, mix, supply/inventory, outages, marketing, and seasonality.

    How to answer: A strong business case would begin by defining the problem scope (Walmart App, 10% WoW revenue drop) and establishing a baseline. The candidate should then propose a structured diagnostic approach, starting with internal factors (app performance, recent updates, marketing campaigns, inventory) and then external factors (competitor actions, economic shifts, seasonality, news events). Finally, they should outline a framework for prioritizing potential drivers based on impact and likelihood, and suggest data sources and analytical methods to validate hypotheses and recommend actionable solutions.

Practice these with instant AI feedback in a live mock interview → Start a Walmart Business Analyst mock

Practise DSA and system design for scale; prepare real project deep-dives; expect large-scale scenario questions

Indicative Business Analyst pay in India: ~₹7–26 LPA (role-level range, not a Walmart-specific figure).

Other roles at Walmart

Business Analyst interviews at other companies