Android Testing and Analysis

Recent paper related to Android testing and Analysis

ASE

ISSTA

ICSE

OOPSLA

ESEC/FSE

Reproduce Flaky

Test Event Reduction

Non-crash bug

ASE

• 2021
  • Characterizing and Detecting Configuration Compatibility Issues in Android Apps
  • Finding the Missing Piece: Permission Specification Analysis for Android NDK
  • Automated Repair for Size-Based Inaccessibility Issues in Mobile Apps
  • Deep GUI: Black-box GUI Input Generation with Deep Learning
  • UI Test Migration Across Mobile Platforms

• 2020
  • Seven Reasons Why: An In-Depth Study of the Limitations of Random Test Input Generation for Android
  • UI obfuscation and its effects on automated UI analysis for Android apps
  • Automated third-party library detection for Android applications: are we there yet?
  • Owl eyes: spotting UI display issues via visual understanding
  • Test automation in Open-Source Android Apps: A Large-Scale Empirical Study
  • ER Catcher: A Static Analysis Framework for Accurate and Scalable Event-Race Detection in Android
  • Speeding up GUI Testing by On-Device Test Generation
• 2019
  • Humanoid: a deep learning-based approach to automated black-box Android app testing
  • Test transfer across mobile apps through semantic mapping
  • Goal-driven exploration for Android applications
  • Randr: Record and replay for android applications via targeted runtime instrumentation
  • LIRAT: layout and image recognition driving automated mobile testing of cross-platform
  • DaPanda: detecting aggressive push notifications in Android apps
  • Test migration between mobile apps with similar functionality
  • MutAPK: source-codeless mutant generation for Android apps
  • Automating app review response generation
  • A qualitative analysis of Android taint-analysis results
  • OAuthLint: an empirical study on OAuth bugs in Android applications
  • Demystifying application performance management libraries for Android
  • Characterizing Android app signing issues
• 2018
  • An empirical study of android test generation tools in industrial cases
  • Understanding and detecting evolution-induced compatibility issues in Android apps
  • Understanding and detecting callback compatibility issues for Android applications
  • Efficiently manifesting asynchronous programming errors in Android apps
  • On adopting linters to deal with performance concerns in Android apps
  • Self-protection of Android systems from inter-component communication attacks
  • A tale of two cities: how WebView induces bugs to Android applications
  • Characterizing and identifying misexposed activities in Android applications
  • Dual-force: understanding WebView malware via cross-language forced execution
• 2017
  • SimplyDroid: efficient event sequence simplification for Android application
  • EHBDroid: beyond GUI testing for Android applications
  • Sketch-guided gui test generation for mobile applications
  • Systematically testing background services of mobile apps
  • UI driven Android application reduction
  • ANDROFLEET: testing WiFi peer-to-peer mobile apps in the large
  • Automated cross-platform inconsistency detection for mobile apps
  • Systematic reduction of GUI test sequences
  • EventFlowSlicer: a tool for generating realistic goal-driven GUI tests
  • Crowd intelligence enhances automated mobile testing
• 2016
  • Automated model-based Android GUI testing using multi-level GUI comparison criteria
  • Reflection-aware static analysis of Android apps
  • Taming Android fragmentation: characterizing and detecting compatibility issues for Android apps
  • Relda2: an effective static analysis tool for resource leak detection in Android apps.

ISSTA

• 2021

  • An Infrastructure Approach to Improving Effectiveness of Android UI Testing Tools
  • GUIDER: GUI Structure and Vision Co-Guided Test Script Repair for Android Apps
  • Semantic Matching of GUI Events for Test Reuse: Are We There Yet?
  • Understanding and Finding System Setting-Related Defects in Android Apps

• 2020

  • Data loss detector: automatically revealing data loss bugs in Android apps
  • Automated classification of actions in bug reports of mobile apps

• 2019

  • SARA: self-replay augmented record and replay for Android in industrial cases
  • Improving random GUI testing with image-based widget detection
  • TestMig: migrating GUI test cases from iOS to Android
  • Mining Android crash fixes in the absence of issue- and change-tracking systems
  • LibID: reliable identification of obfuscated third-party Android libraries
  • QADroid: regression event selection for Android applications
  • Learning user interface element interactions

• 2018

  • Automatically translating bug reports into test cases for mobile apps
  • LAND: a user-friendly and customizable test generation tool for Android apps
  • CiD: automating the detection of API-related compatibility issues in Android apps
  • Test migration for efficient large-scale assessment of mobile app coding assignments

• 2017

  • Data flow oriented UI testing: exploiting data flows and UI elements to test Android applications
  • Semi-automated discovery of server-based information oversharing vulnerabilities in Android applications

• 2016

  • Monkey see, monkey do: effective generation of GUI tests with inferred macro events
  • Sapienz: multi-objective automated testing for Android applications
  • DroidRA: taming reflection to support whole-program analysis of Android apps
  • Energy-aware test-suite minimization for android apps

• 2015

  • Systematic execution of android test suites in adverse conditions

ICSE

• 2021

  • ATVHunter: Reliable Version Detection of Third-Party Libraries for Vulnerability Identification in Android Apps
  • An Empirical Analysis of UI-based Flaky Tests
  • An Empirical Assessment of Global COVID-19 Contact Tracing Applications
  • An Empirical Study on Deployment Faults of Deep Learning Based Mobile Applications
  • App's Auto-Login Function Security Testing via Android OS-Level Virtualization
  • Automatically Matching Bug Reports With Related App Reviews
  • Don't Do That! Hunting Down Visual Design Smells in Complex UIs against Design Guidelines
  • Layout and Image Recognition Driving Cross-Platform Automated Mobile Testing
  • It Takes Two to Tango: Combining Visual and Textual Information for Detecting Duplicate Video-Based Bug Reports
  • Prioritize Crowdsourced Test Reports via Deep Screenshot Understanding
  • RAICC: Revealing Atypical Inter-Component Communication in Android Apps
  • IMGDroid: Detecting Image Loading Defects in Android Applications

• 2020

  • LABLEDROID: Unblind your apps: predicting natural-language labels for mobile GUI components by deep learning
  • Translating video recordings of mobile app usages into replayable scenarios
  • Multiple-entry testing of Android applications by constructing activity launching contexts
  • How Android developers handle evolution-induced API compatibility issues: a large-scale study
  • ComboDroid: generating high-quality test inputs for Android apps via use case combinations
  • RoScript: a visual script driven truly non-intrusive robotic testing system for touch screen applications
  • Time-travel testing of Android apps
  • An empirical assessment of security risks of global Android banking apps
  • Accessibility issues in Android apps: state of affairs, sentiments, and ways forward
  • Collaborative bug finding for Android apps

• 2019

  • IconIntent: automatic identification of sensitive UI widgets based on icon classification for Android apps
  • Mimic: UI compatibility testing system for Android apps
  • Search-based energy testing of Android
  • Practical GUI testing of Android applications via model abstraction and refinement
  • Towards understanding and reasoning about Android interoperations

• 2018

  • Automated reporting of GUI design violations for mobile apps
  • Leveraging program analysis to reduce user-perceived latency in mobile applications
  • Software protection on the go: a large-scale empirical study on mobile app obfuscation
  • Repairing crashes in Android apps
  • DetReduce: minimizing Android GUI test suites for regression testing

• 2017

  • Analysis and testing of notifications in Android wear applications
  • Adaptive unpacking of Android apps
  • Automatic text input generation for mobile testing
  • LibD: scalable and precise third-party library detection in android markets

• 2016

  • Reducing combinatorics in GUI testing of android applications
  • MobiPlay: a remote execution based record-and-replay tool for mobile applications
  • VDTest: an automated framework to support testing for virtual devices
  • PRADA: prioritizing android devices for apps by mining large-scale usage data

OOPSLA

• 2021
  • Fully Automated Functional Fuzzing of Android Apps for Detecting Non-Crashing Logic Bugs
• 2020
  • A Large-Scale Longitudinal Study of Flaky Tests
  • LiveDroid: Identifying and Preserving Mobile App State in Volatile Runtime Environments
• 2018
  • Robust Relational Layouts Synthesis from Examples for Android
• 2016
  • Finding Resume and Restart Errors in Android Applications
• 2015
  • Versatile Yet Lightweight Record-and-replay for Android
  • Interactively Verifying Absence of Explicit Information Flows in Android Apps
  • Scalable Race Detection for Android Applications

ESEC/FSE

• 2021

  • Benchmarking Automated GUI Testing for Android against Real-World Bugs
  • Checking Conformance of Applications against GUI Policies
  • Data-Driven Accessibility Repair Revisited: On the Effectiveness of Generating Labels for Icons in Android Apps
  • An Empirical Study of GUI Widget Detection for Industrial Mobile Games

• 2020

  • All Your App Links Are Belong to Us: Understanding the Threats of Instant Apps Based Attacks
  • Automated Construction of Energy Test Oracles for Android
  • Object Detection for Graphical User Interface: Old Fashioned or Deep Learning or a Combination?
  • Static Asynchronous Component Misuse Detection for Android Applications

• 2019

  • Preference-Wise Testing for Android Applications
  • ServDroid: detecting service usage inefficiencies in Android applications
  • Together strong: cooperative Android app analysis

• 2018

  • AppFlow: Using Machine Learning to Synthesize Robust, Reusable UI Tests
  • Do Android Taint Analysis Tools Keep Their Promises?
  • FraudDroid: Automated Ad Fraud Detection for Android Apps
  • Neural-Augmented Static Analysis of Android Communication

• 2017

  • µDroid: An Energy-Aware Mutation Testing Framework for Android
  • PATDroid: permission-aware GUI testing of Android
  • Enabling Mutation Testing for Android Apps
  • Guided, Stochastic Model-Based GUI Testing of Android Apps

• 2016

  • Understanding and detecting wake lock misuses for Android applications
  • DiagDroid: Android performance diagnosis via anatomizing asynchronous executions
  • Minimizing GUI event traces
  • What would users change in my app? summarizing app reviews for recommending software changes

Reproduce Flaky

• LIRAT: Layout and Image Recognition Driving Automated Mobile Testing of Cross-Platform (ASE '19)

• SARA: Self-Replay Augmented Record and Replay for Android in Industrial Cases (ISSTA '19)

• Record and replay for Android: are we there yet in industrial cases? （ESEC/FSE '17)

• RANDR: Record and Replay for Android Applications via Targeted Runtime Instrumentation (ASE '19)

• Translating video recordings of mobile app usages into replayable scenarios (ICSE '20)

• Versatile Yet Lightweight Record-and-replay for Android (OOPSLA '15)

• MobiPlay: A Remote Execution Based Record-and-replay Tool for Mobile Applications (ICSE '16)

• Mosaic: cross-platform user-interaction record and replay for the fragmented android ecosystem (ICSE '16)

• A Large-Scale Longitudinal Study of Flaky Tests(OOPSLA '20)

• An Empirical Analysis of UI-based Flaky Tests (ICSE '21)

• Concurrency-related Flaky Test Detection in Android Apps

• iDFlakies: A framework for detecting and partially classifying flaky tests (ICST '19)

• DeFlaker: Automatically detecting flaky tests (ICSE '18)

• Making system user interactive tests repeatable: when and what should we control? (ICSE '15)

• Who broke the build?: Automatically identifying changes that induce test failures in continuous integration at Google scale (ICSE '2017)

• Root causing flaky tests in a large-scale industrial setting (ISSTA '2019)

• A study on the lifecycle of flaky tests (ICSE '2020)

• What Causes My Test Alarm? Automatic Cause Analysis for Test Alarms in System and Integration Testing (ICSE '2017)

• Understanding flaky tests: The developers perspective (ESEC/FSE '2019)

• The impact of failing, flaky, and high failure tests on the number of crash reports associated with Firefox builds (ESEC/FSE '2018)

• Debugging the performance of Maven’s test isolation: Experience report(ISSTA '2020)

• Reliable testing: Detecting state-polluting tests to prevent test dependency (ISSTA '2015)

• Improving oracle quality by detecting brittle assertions and unused inputs in tests(FSE '2014)

• Detecting assumptions on deterministic implementations of non-deterministic specifications (ICST'2016)

• Empirically revisiting the test independence assumption (ISSTA'2014)

• Practical test dependency detection (ICST'2018)

• An empirical analysis of flaky tests (FSE'2014)

• iFixFlakies: A framework for automatically fixing order-dependent flaky tests (ESEC/FSE'2019)

• An Empirical Study of Flaky Tests in Android Apps (ICSME'2018)

Test Event Reduction

• Efficient testing of GUI applications by event sequence reduction(Science of Computer Programming '2021)
• Understanding Ineffective Events and Reducing Test Sequences for Android Applications (TASE '2019)
• Event trace reduction for effective bug replay of Android apps via differential GUI state analysis (ESEC/FSE '2019)
• Context-based event trace reduction in client-side JavaScript applications (ICST '2018)
• DetReduce: minimizing Android GUI test suites for regression testing (ICSE '2018)
• SimplyDroid: Efficient event sequence simplification for android application (ASE '2017)
• Systematic reduction of GUI test sequences (ASE '2017)
• Constraint-based event trace reduction (FSE '2016)
• Minimizing GUI event traces (FSE '2016)
• On the use of delta debugging to reduce recordings and facilitate debugging of web applications (ESEC/FSE '2015)

Non-crashing bug

• Data Loss Detector: Automatically Revealing Data Loss Bugs in Android Apps (ISSTA '2020)
• Understanding and finding system setting-related defects in Android apps (ISSTA '2021)
• QUANTUM: Automated Generation of Oracles for Testing User-Interaction Features of Mobile Apps (ICST '2014)
• Is this the lifecycle we really want?: an automated black-box testing approach for Android activities (INTUITESTBEDS 2018)
• UI Test Migration Across Mobile Platforms （ASE '21)
• Owl eyes: spotting UI display issues via visual understanding (ASE '20)
• Test migration between mobile apps with similar functionality (ASE '19)
• Sketch-guided gui test generation for mobile applications (ASE '17)
• EventFlowSlicer: a tool for generating realistic goal-driven GUI tests (ASE '17)
• QADroid: regression event selection for Android applications (ISSTA '2019)
• Monkey see, monkey do: effective generation of GUI tests with inferred macro events (ISSTA '2016)

Find non-crashing bug

• Fully Automated Functional Fuzzing of Android Apps for Detecting Non-Crashing Logic Bugs (OOPSLA '21)
• Understanding and finding system setting-related defects in Android apps (ISSTA '21)
• Data Loss Detector: Automatically Revealing Data Loss Bugs in Android Apps (ISSTA '20)
• Owl eyes: spotting UI display issues via visual understanding (ASE '20)
• Mimic: UI compatibility testing system for Android apps (ICSE '19)
• A tale of two cities: how WebView induces bugs to Android applications (ASE '18')
• Finding Resume and Restart Errors in Android Applications (OOPSLA '16)
• THOR: Systematic Execution of Android Test Suites in Adverse Conditions (ISSTA '15)
• QUANTUM: Automated Generation of Oracles for Testing User-Interaction Features of Mobile Apps (ICST '14)
• IMGDroid: Detecting Image Loading Defects in Android Applications (ICSE '21)
• LiveDroid: Identifying and Preserving Mobile App State in Volatile Runtime Environments

others related bug study

• Runtime Permission Issues in Android Apps: Taxonomy, Practices, and Ways Forward
• Actor Concurrency Bugs: A Comprehensive Study on Symptoms, Root Causes, API Usages, and Differences (OOPSLA '2020)
• A Large-Scale Longitudinal Study of Flaky Tests (OOPSLA '2020)

Human-provided oracles to find non-crashing bugs

• THOR: Systematic Execution of Android Test Suites in Adverse Conditions (ISSTA '2015)
• ChimpCheck: property-based randomized test generation for interactive apps
• AppFlow: using machine learning to synthesize robust, reusable UI tests (ESEC/FSE '2018)
• Automation of Android applications functional testing using machine learning activities classification (MOBILESofT '2018)
• Test Migration Between Mobile Apps with Similar Functionality (ASE '2019)
• Test Transfer Across Mobile Apps Through Semantic Mapping (ASE '2019)
• Reinforcement Learning-Driven Test Generation for Android GUI Applications using Formal Specifications (ARXIV '2019)
• Augusto: exploiting popular functionalities for the generation of semantic GUI tests with Oracles (ICSE '2018)
• Automated test oracles for GUIs (FSE '2000)
• What Test Oracle Should I Use for Effective GUI Testing? (ASE '2003)
• Designing and comparing automated test oracles for GUI-based software applications (ACM Trans. Softw. Eng. Methodol '2007)
• ReNaLART: Automating test oracles from restricted natural language agile requirements (Expert Syst. J. Knowl. Eng '2021)

Uses differential testing to overcome the oracle problem

• SPAG-C: On the Accuracy, Efficiency, and Reusability of Automated Test Oracles for Android Devices (IEEE Trans. Software Eng)

• DIFFDROID: Automated cross-platform inconsistency detection for mobile apps (ASE '2017)

Generates automated oracles for a specific class of user interactions

• QUANTUM: Automated Generation of Oracles for Testing User-Interaction Features of Mobile Apps (ICST '2014)
• THOR: Systematic Execution of Android Test Suites in Adverse Conditions (ISSTA '2015)
• ACETON: Automated construction of energy test oracles for Android (ESEC/FSE '2020)