THE VERDICT · INCONCLUSIVE
The spike eased, but that did not always mean a return to the earlier level.
All eight apps with enough follow up had a lower combined bad review share than on their spike day. For five, that share remained at least 10 percentage points above the earlier baseline.
My rule required at least 10 apps with enough follow up and a majority still elevated. Only eight qualified, so I cannot claim the theory passed.
See the results ↓
MY QUESTION
Does a quieter day mean the problem is over?
I looked at the share of written reviews with one or two stars. A fall from an extreme day and a return to the previous level are two different things.
I measured each app’s bad review share over the previous seven days.
I chose the first qualifying day where the bad share was at least 20 points higher than the baseline.
I pooled the next three days and compared their bad review share with the spike and the baseline.
I selected each first spike before checking its follow up. Two of ten selected apps lacked enough follow up to qualify.
MY THEORY VS THE RESULT
Five of eight stayed elevated in the combined follow up.
My theory
Most apps would remain at least 10 points above their baseline, with enough data from at least 10 apps.
What I found
Five of eight eligible apps were still elevated across the combined three days. The minimum sample was not reached, and other definitions gave different results.
earlier baseline → spike → next three days
Only eight apps had enough follow up; the planned minimum of ten was not met.
See the original result chart
The combined share is total bad reviews divided by total written reviews across the three days.
None of the eight was at least 10 points above baseline on every individual follow up day. A combined result can hide day to day changes.
REAL APPS IN MY SAMPLE
Two apps, two different follow up patterns.
These historical examples are from US App Store written reviews in 2026. They do not tell me why the review mix changed.
APP STORE · UNITED STATES
Claude by Anthropic
Its earlier baseline was 34 bad reviews out of 105, or 32.4%. On the spike day it was 11 of 14, or 78.6%. Across the next three days it was 22 of 42, or 52.4%: lower than the spike but 20 points above baseline.
The first follow up day was 27.3%, so the pooled result does not mean every day stayed elevated.
APP STORE · UNITED STATES
Kalshi: Trade Sports & Events
The baseline was 60 bad reviews out of 168, or 35.7%. The spike day was 10 of 15, or 66.7%. The next three days combined were 32 of 104, or 30.8%, below the earlier baseline.
APP STORE · UNITED STATES
Telegram Messenger
The earlier share was 56 of 92, or 60.9%. The spike was 10 of 12, or 83.3%, and the combined next three days were 38 of 52, or 73.1%: lower than the spike but 12.2 points above baseline.
MY ASO TAKEAWAY
Compare with the peak and with the earlier baseline.
My ASO tip: Put the count and share of bad written reviews beside each comparison. Small daily samples can swing sharply.
My ASO strategy: Track a consistent baseline and inspect the following days separately as well as together. Read the complaints and product changes before deciding what to investigate.
My ASO warning: An extreme day can naturally be followed by a less extreme day. This study has no suitable control group and cannot prove recovery, causation or an effect on conversion or rankings.
WHAT I COULD NOT PROVE
Here is where the evidence stops.
- All apps: Eight qualifying apps from a selected US chart panel are not a representative sample.
- Complete reviews: The retrieved written review feed was capped and may omit reviews. Timestamps can reflect edits.
- Every day: A pooled three day result does not mean each individual day met the threshold.
- A reliable rule: The minimum sample was not met and sensitivity checks changed the finding. For example, counting only one star reviews left three of nine elevated.
- All users: Written reviewers are not all users, and star only ratings were not included.
SOURCES & METHODS
Want to check my work?
I reused the saved US App Store written review facts from my review spike study and a panel selected from AppOrbit’s archived US chart. The supplied independent verifier reconstructed the classifications and sensitivity checks. It checks processing, not whether the feed was complete.
The evidence and original technical report remain local while third party redistribution rights are reviewed.
Read the original report and technical details
The findingApp examplesAll eight appsDay by dayExtra checksMethod & limitsDownload evidence What happens after a bad-review spike?Better than the worst day.
Still worse than before?
All eight apps we could follow had a lower percentage of bad reviews after their spike day. But five still had a bad-review share at least 10 percentage points above their earlier baseline.
This is a small, retrospective study of written App Store reviews. It shows why “the spike has eased” and “feedback is back to its previous level” can mean different things.
8 / 8had a lower bad-review share than on the spike day5 / 8were still at least 10 points above baseline across the next three days0 / 8met that threshold on each of the three days separately The examples support a useful distinction, not a proven general rule.Our theory was that most apps would remain above their previous bad-review level after a spike. We required at least ten apps with sufficient follow-up before calling that pattern supported. Only eight qualified, and the result changed under other reasonable definitions. The theory did not pass the full planned rule.
Why this matters for ASO
An ASO report can say an app’s negative feedback is improving because yesterday was worse. But users may still be leaving a much higher percentage of bad reviews than before the spike.
This study separates two questions: Did the bad-review percentage fall from its peak? And did it return toward the app’s earlier level? The same app can improve on the first measure and remain elevated on the second.
Here, “bad” means a 1-star or 2-star written review. A change from 30% bad to 50% bad is a rise of 20 percentage points. We are measuring the mix of retrieved written reviews, not the percentage of all users who are unhappy.
01 / Two real apps, two different outcomesClaude improved from its spike, but remained above its baseline.
| Period | Bad / all reviews | Bad-review share |
|---|---|---|
| Previous seven days: 28 September to 4 October | 34 / 105 | 32.4% |
| Spike day: 5 October | 11 / 14 | 78.6% |
| Following three days: 6 to 8 October | 22 / 42 | 52.4% |
The share fell from 78.6% to 52.4%. That is a substantial drop from the spike day. Yet the follow-up was still 20 points above the 32.4% baseline.
Calling that a return to the previous review mix would hide the remaining difference. Calling it three continuously bad days would also be wrong: the first follow-up day was 27.3% bad, followed by 60.0% and 62.5%.
Kalshi fell below its earlier baseline.
| Period | Bad / all reviews | Bad-review share |
|---|---|---|
| Previous seven days: 8 to 14 October | 60 / 168 | 35.7% |
| Spike day: 15 October | 10 / 15 | 66.7% |
| Following three days: 16 to 18 October | 32 / 104 | 30.8% |
Kalshi’s follow-up share was 4.9 points below its baseline. This is a different observed pattern from Claude’s. Neither example tells us what caused the spike, whether a product issue was fixed, or what happened to app rankings.
02 / Every app with enough follow-upFive stayed above baseline. Three fell below it.
“Still elevated” means the pooled share over the next three days was at least ten points above the previous seven-day baseline. The three-day figure is total bad reviews divided by total reviews, not an unweighted average of three daily percentages.
| App & spike date | Previous week | Spike day | Next three days | Change from baseline | Still elevated? |
|---|---|---|---|---|---|
| Telegram MessengerSpike: 2026-10-01 | 60.9%56/92 bad | 83.3%10/12 bad | 73.1%38/52 bad | +12.2 points | Yes |
| Claude by AnthropicSpike: 2026-10-05 | 32.4%34/105 bad | 78.6%11/14 bad | 52.4%22/42 bad | +20.0 points | Yes |
| Peacock TV: Stream TV & MoviesSpike: 2026-10-12 | 46.8%51/109 bad | 73.3%11/15 bad | 60.9%28/46 bad | +14.1 points | Yes |
| Kalshi: Trade Sports & EventsSpike: 2026-10-15 | 35.7%60/168 bad | 66.7%10/15 bad | 30.8%32/104 bad | -4.9 points | No |
| TikTok Pro - EventsSpike: 2026-10-17 | 28.1%18/64 bad | 75.0%21/28 bad | 58.3%21/36 bad | +30.2 points | Yes |
| CapCut: Photo & Video EditorSpike: 2026-10-18 | 46.7%98/210 bad | 66.7%22/33 bad | 41.2%28/68 bad | -5.5 points | No |
| Depop - Buy & Sell ClothesSpike: 2026-10-18 | 34.4%67/195 bad | 55.0%11/20 bad | 30.4%17/56 bad | -4.0 points | No |
| Capital One MobileSpike: 2026-10-19 | 26.3%46/175 bad | 48.6%18/37 bad | 43.1%53/123 bad | +16.8 points | Yes |
The median change from baseline was +13.1 percentage points. The median change from the spike day was -20.7 points. These summarize eight selected apps; they are not estimates for all App Store apps.
Two selected apps did not have enough follow-up
Amazon Prime Video, 10 October: the follow-up contained 30 reviews, but the last day had only four. Our minimum was five per day.
Polymarket: Trade Live Sports, 22 October: the next three days contained only 21 reviews, below the required 30.
We selected each app’s earliest qualifying spike before checking future data. We did not replace either event with a later spike that happened to have more follow-up. All ten selected apps, including these exclusions, are in the evidence download.
No app stayed above our threshold on all three days.
Five apps passed the pooled three-day test. None passed it on every individual day. That is why this report says their combined follow-up share remained elevated, not that each day was consistently worse.
| App & follow-up dates | Day 1 | Day 2 | Day 3 | Baseline + 10 points |
|---|---|---|---|---|
| Telegram Messenger2026-10-02 to 2026-10-04 | 85.0%17/20 bad | 69.2%18/26 bad | 50.0%3/6 bad | 70.9% |
| Claude by Anthropic2026-10-06 to 2026-10-08 | 27.3%3/11 bad | 60.0%9/15 bad | 62.5%10/16 bad | 42.4% |
| Peacock TV: Stream TV & Movies2026-10-13 to 2026-10-15 | 70.0%7/10 bad | 52.4%11/21 bad | 66.7%10/15 bad | 56.8% |
| Kalshi: Trade Sports & Events2026-10-16 to 2026-10-18 | 17.4%4/23 bad | 41.7%15/36 bad | 28.9%13/45 bad | 45.7% |
| TikTok Pro - Events2026-10-18 to 2026-10-20 | 65.2%15/23 bad | 57.1%4/7 bad | 33.3%2/6 bad | 38.1% |
| CapCut: Photo & Video Editor2026-10-19 to 2026-10-21 | 48.0%12/25 bad | 42.3%11/26 bad | 29.4%5/17 bad | 56.7% |
| Depop - Buy & Sell Clothes2026-10-19 to 2026-10-21 | 11.8%2/17 bad | 35.0%7/20 bad | 42.1%8/19 bad | 44.4% |
| Capital One Mobile2026-10-20 to 2026-10-22 | 33.3%13/39 bad | 59.1%26/44 bad | 35.0%14/40 bad | 36.3% |
Each cell shows bad-review share and bad / total written reviews. Thresholds display rounded percentages; classifications use exact counts.
04 / Does the result survive different rules?The majority finding was not consistent.
We specified five checks before calculating this experiment’s results. Each changes one part of the primary definition, with the larger-sample check changing all four sample-size minimums together. Each version selects the earliest qualifying spike per app before checking follow-up.
| Rule | Apps with a spike | Enough follow-up | Still elevated | Share |
|---|---|---|---|---|
| Primary definition | 10 | 8 | 5 / 8 | 62.5% |
| Count only 1-star reviews as bad | 10 | 9 | 3/9 | 33.3% |
| Start with a smaller, 10-point spike | 16 | 16 | 6/16 | 37.5% |
| Start with a larger, 30-point spike | 4 | 3 | 2/3 | 66.7% |
| Require 20 points above baseline afterward | 10 | 8 | 2/8 | 25.0% |
| Require larger review samples | 4 | 2 | 1/2 | 50.0% |
Counting only 1-star reviews left 3 of 9 apps elevated. Starting with a smaller ten-point spike produced 6 of 16. Both are below half. Starting with a larger thirty-point spike left just three eligible apps.
Requiring the follow-up to stay twenty points above baseline reduced the primary result to 2 of 8. The larger-sample check left only two apps, so it cannot settle the question.
The larger-sample minimums were 100 baseline reviews, 20 spike-day reviews, 60 follow-up reviews and ten on each follow-up day. All variants and app-level results are included in the download.
What if we count every spike, including repeated apps?
There were 17 qualifying spike days across ten apps. Fifteen had usable follow-up, spread across nine apps. Seven of those fifteen had an elevated pooled follow-up share. Repeated apps and overlapping windows make these dependent observations. They are not fifteen independent confirmations, and this diagnostic does not replace the primary first-spike-per-app result.
05 / How we tested itOne spike per app, then three days of follow-up.
- Start with the same 57-app US panel. These apps had appeared in the archived US top-free apps chart’s top 20 between 19 September and 25 October. This study uses their written reviews, not their rankings.
- Check 27 possible spike dates per app. Dates run from 26 September through 22 October 2026, giving 1,539 candidate app-days. Follow-up ends no later than 25 October. Every window uses UTC.
- Require enough earlier reviews. At least 50 reviews in the previous seven days and ten on the spike day. Retrieved timestamps must span the baseline start and the end of the spike day.
- Define a sharp spike. At least five bad reviews on the day, with a bad-review share at least twenty percentage points above baseline. Unlike Experiment 18, the bad-review count does not have to double.
- Select the earliest qualifying spike per app. Do this before looking at whether its future data pass the coverage requirements.
- Require usable follow-up. At least 30 written reviews across the next three days, with at least five on each day, and retrieved timestamps extending beyond the follow-up window.
- Compare with the original baseline. The main outcome is a pooled follow-up share at least ten points above that baseline. We also check each follow-up day separately.
Where the 1,539 candidate days went
| First failed requirement, or result | App-days |
|---|---|
| Retrieved history started too late | 689 |
| Fewer than 50 baseline reviews | 453 |
| Fewer than ten spike-day reviews | 96 |
| No reviews retrieved for the app | 54 |
| Enough baseline/day data, but no qualifying spike | 230 |
| Qualifying spike | 17 |
Reused data, not a new review collection
We reused 21,750 written-review records collected for Experiment 15 on 27 October 2026, from 437 public-feed requests. The feeds returned reviews for 55 of the 57 apps, with up to ten pages per app. Empty or insufficient data were not counted as healthy feedback.
The rules were written before calculating Experiment 19’s outcomes. However, the review pool had already been analyzed in earlier experiments. This is exploratory follow-on research, not an untouched test set or an externally registered experiment.
Why a fall after the spike does not prove an app recovered
We deliberately selected unusually bad days. Even without a real improvement in an app, an unusually extreme observation can be followed by a less extreme one. This is often called regression toward the mean. We did not compare these apps with a suitable non-spike control group, so we cannot separate that effect from genuine changes in user experience.
Apple allows reviews and ratings to be edited, with the latest submission replacing the previous one. The timestamps in a later feed can therefore reflect edits rather than original submissions. Apple’s ratings and reviews documentation.
The public feed can omit deleted reviews, truncate older history or lag behind activity. Timestamps spanning a window do not prove complete coverage. Written reviewers are not all app users, and star-only ratings are not included. Apps can also share external events on the same dates.
This study does not establish that a spike predicts future bad reviews better than another signal. It does not measure ranking, conversion, installs, retention, listing localization or the impact of an ASO change.
06 / Data you can inspectThe full evidence is included.
The ZIP contains all 1,539 candidate days, all ten selected apps, all 17 spike events, the five planned variations, deidentified review facts, source-request logs, the written rules, analysis code and independent verification.
A second implementation rebuilt the counts using UTC daily buckets and exact fractions. It verified the primary classifications and all five sensitivity variants, passing 74,442 checks. Most checks validate review IDs, scores and timestamps. This confirms processing consistency, not source completeness.
Extract and run python analyse.py, then python verify.py. Both run offline using Python’s standard library. No reviewer names or review text are redistributed.
- Apple US written-review feed: Claude example. The download preserves original acquisition URLs, timestamps and response hashes. Live feeds change.
- Apple ratings and reviews overview, checked 27 October 2026. Documents edited review behavior.
- AppOrbit by ivershuo, pinned source. Earlier chart source used to select the panel, under ODbL 1.0. Attribution and derived-panel license included.
Keep exploring
All ASO experiments · Compare review counts and shares · Compare ratings and recent reviews