Samsung Android Crash & Performance Analysis

0 %
100 %
Information about Samsung Android Crash & Performance Analysis
Technology

Published on February 14, 2014

Author: crittercism

Source: slideshare.net

Description

This document provides a high level analysis of device performance metrics pulled from the Crittercism big data platform for August 2013:
- Top 100 Samsung Android devices (based on app loads)
- Installed base of ~250M (Android) devices
- Total of 10B+ app loads

Samsung Device Performance Analysis! San Francisco, October 2013!

Agenda! Background ß! Data Analysis! Next Steps!

Background! This document provides a high level analysis of device performance metrics pulled from the Crittercism big data platform for August 2013:! •  Top 100 Samsung Android devices (based on app loads) ! •  Installed base of ~250M (Android) devices! •  Total of 10B+ app loads!

Key take-aways! Crashes & performance issues affect all devices regardless of app loads, however Samsung tablets (Galaxy Tab) and “phablets” (Galaxy Note) have the highest crash rates, 3-4x the crash rate of the best phones.! Some Samsung devices sold by non-US carriers are experiencing much higher crash rates than their US counterparts, such as the Galaxy S III in both Japan and Korea.! Other “bad offenders” are older models still in use like the Galaxy Y and Galaxy Ace that were shipped with Android versions as old as Froyo and Gingerbread (both originally released back in 2010).! More than 50% of Samsung devices have an average crash rate of greater than 0.25%; in addition, 10 of the top 100 devices account over 60% of total usage, suggesting a Pareto distribution of performance issues. !

Agenda! Background! Data Analysis ß! Next Steps!

2.00% 1.50% 0.00% sc-06 gt-n8000 gt-p7500 gt-p6200 gt-p6800 gt-p7510 gt-s5360 gt-p1000 gt-p3100 gt-s5570 gt-s6102 gt-p3110 gt-s5660 shw-m250 shv-e250 gt-p5100 sc-04 gt-s5830 gt-p3113 gt-s5839 sch-r820 shv-e120 sc-02 sgh-i997 sgh-t889 shv-e210 sgh-t959 sch-r530 sch-s720 gt-s5302 gt-p5110 gt-n7100 sc-03 sch-s738 gt-s5300 sph-m930 sgh-t999 shv-e160 sch-i500 sch-i605 gt-s7562 sph-l900 sph-d700 gt-s6802 gt-i9305 gt-s5301 gt-p5113 gt-i9003 gt-n7105 gt-i9000 sgh-i747 shv-e300 sgh-i317 sph-l710 gt-i9105 gt-n7000 gt-i9082 sch-i535 gt-i8160 sch-r760 gt-s7560 gt-s7500 gt-s6500 gt-i9500 gt-i9070 sgh-i777 gt-b5330 shw-m440 gt-i8150 gt-i9100 sph-d710 gt-s6810 sgh-m919 gt-i9195 gt-i9001 sph-l300 sch-r830 sgh-t769 sgh-t679 sph-m830 gt-i8190 sph-l720 sch-i545 sgh-i727 sgh-i537 sch-i510 sch-i200 sgh-i547 gt-i9505 sch-r970 sch-i405 sch-i415 sgh-t989 sgh-t699 sph-m950 gt-i8730 sgh-i337 gt-i9300 sgh-i717 sgh-i437 3 orders of magnitude range for crash rates! Crash Rates for Top 100 Samsung Devices (by App Loads)! 5.00% 4.50% 4.00% 3.50% 3.00% Lowest! Highest! Mean! 2.50% 0.05%! 4.74%! 0.38%! Median! Std. Dev.! 0.28%! 0.58%! 3 orders of magnitude! 1.00% 0.50%

Performance issues affect all devices! Performance Correlation for Top 100 Devices ! Performance for Top 30 Devices (by App Loads)! Device! App Loads (Millions)! gt-i9300 gt-i9505 sgh-t989 gt-n7000 sph-l720 gt-i9500 sch-i545 sph-l710 sgh-t999 gt-i9070 gt-i9001 gt-i9082 sgh-i717 gt-p5100 sgh-i727 521 426 371 367 288 254 201 184 180 179 174 165 161 148 142 138 130 119 114 98 92 86 83 81 79 77 66 63 910 Million App Loads (x) vs. Crash Rate (y)! Crash Rate (%)! 2,953 0.07% 0.17% 0.10% 0.11% 0.08% 0.14% 0.26% 0.07% 0.11% 0.16% 0.21% 0.35% 0.11% 0.25% 0.27% 0.32% 0.28% 0.20% 0.14% 0.06% 0.11% Crashes are independent from app loads, affect all devices! 5.00% 4.00% 3.00% 2.00% 0.52% 0.66% 1.00% 0.28% 0.26% 0.35% 0.24% 0.23% 0.00% 0.59% - 1,000 R² = 0.01284 2,000 3,000 0.73% -1.00% Crash rates do not correlate with app loads (R2 =0.01) ! 4,000

Distribution for app loads / crash rates!

Probability distribution (fitted)! Probability Distribution (30 day sample for top 100 devices, 10B+ app loads)! •  More than 50% of Samsung devices have an average crash rate of greater than 0.25%! Lowest Highest Mean 0.05% 4.74% 0.38% Median Std. Dev. 0.28% 0.58% 0.00% 0.50% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% 5.50% •  10 of the top 100 devices account over 60% of total usage, suggesting a Pareto distribution !

Agenda! Background! Data Analysis! Next Steps ß!

Add a comment

Related presentations

Related pages

QuikCoach V3 - Sports Analysis - Android Apps on Google Play

QuikCoach is a sports video analysis and planning application for Android ... Samsung S4, S3, Galaxy Tab ... The best video performance analysis ...
Read more

2-5x increase in crashes from Samsung devices on Android 4 ...

We've since tested on Samsung Galaxy S5 (Android 4 ... app startup crash on a Samsung ... Unity 5 on Android, some people report lower performance ...
Read more

Automate Android Crash Reports with ACRA: A Tutorial | Toptal

Automated Android Crash Reports with ... (for analysis) or, to be more ... Note that the Android crash metrics available for visualization will depend on ...
Read more

Monitor and Restart Killed Apps with KeepRunning

Analysis. Android 7.0 Compatibility Document Released ... Samsung Sent us a “Note 7 Return Kit” with a ... Monitor and Restart Killed Apps with ...
Read more

Anyone have Crash Bandicoot 1.1.0 apk? | Sony Ericsson ...

Analysis. Which Current or ... Play Themes and Apps Anyone have Crash Bandicoot ... to reinstall android 2.3.4 and copy the crash bandicoot apk ...
Read more

Hudl Technique - Android Apps on Google Play

Hudl Technique, formerly Ubersense ... * Hudl Technique is now compatible with Android M! ... The best video performance analysis solution now ...
Read more

Which platform crashes more, Android or iOS? - Phone Arena

Which platform crashes more, Android or ... system analysis of the the both iOS and android ... my needs and android phones crash most ...
Read more

[XPOSED] Samsung Kitkat SystemServer Crash F… | Xposed General

Analysis. OnePlus 3T XDA ... Google Pixel XL Performance Stress Tests, ... [XPOSED] Samsung Kitkat SystemServer Crash Fix (for random reboots) by ...
Read more