Selected case studies from SYBO Games (Subway Surfers) · Senior Product Data Analyst
We started working on improving the game initialization funnel because there was a drop-off where we were losing users who never even got to load the game.
Timeouts on asset loading: Median of 4.2s on older Android devices, frequently hitting the 5s timeout and forcing a crash.
Config fetch failures: A subset of iOS users was failing the remote config step, causing a silent crash with no retry logic.
Engineering fixed the timeout logic and added retry handling. Drop-off improved measurably and the dashboard became an ongoing monitoring tool for new releases.
The mission system drives engagement by guiding players through game features. To advance levels, users must complete sets of 3 missions across 35 total levels. The PM asked for a progression analysis to understand where players were getting stuck.
Sharp drop-off between levels 5 and 6: From ~71% to ~34% — much steeper than any other transition. This flagged a specific mission at level 6 as the likely cause.
Mission 3: "Buy a mystery box from the shop." After simulating the action myself, I found the mystery box was positioned very low in the shop scroll — not visible on first open, with no visual cue pointing to it.
When a user had this mission active and opened the shop, the game automatically scrolled to the mystery box and displayed a badge highlighting it.
The Welcome Pack is a $4.99 limited-time offer available to new users during their first 3 days. It is surfaced in the shop and also shown as a pop-up after the user's first 3 games. We observed conversion was lower than expected, so we analyzed whether the percentage of users exposed to the pop-up was aligned with expectations — which should equal the % of users who play at least 3 games on day 1.
Hypothesis: "If we show the Welcome Pack pop-up earlier in the session, we'll increase exposure and that will drive higher conversion and ARPDAU."
| Metric | Control | Variant A | Variant B |
|---|---|---|---|
| Pop-up exposure | 31% | 78% +151% · significant | 71% +129% · significant |
| ARPDAU (IAP) | $0.031 | $0.032 · not significant | $0.031 · not significant |
| D1 Retention | 38.2% | 37.9% · no impact | 38.1% · no impact |
Exposure increased significantly for both variants, but ARPDAU and retention didn't move. The team decided not to ship either variant and redirected focus toward the offer design itself.