MicroservicesTesting

A collection of papers and resources about the study "Unveiling the Microservices Testing Methods, Challenges, Solutions, and Solutions Gaps : A Systematic Mapping Study"

Microservices architecture (MSA) is widely used by enterprises and related practitioners. Due to the importance of MSA in the industry, failure to identify its potential faults and errors will cause serious consequences. Consequently, it is imperative to conduct testing on the MSA to guarantee its quality and reliability. As a key task in the software development lifecycle, microservices testing can effectively identify defects and errors caused by incorrect or unexpected behavior of microservices software, ensuring the quality of microservices software. Currently, related reviews lack a comprehensive summary of the challenges and solutions faced by microservices testing. To fill this gap, this study provides a comprehensive review of the microservices testing. It analyzes 93 primary studies from 19595 pieces of research, eventually identifying nine categories of microservices testing methods, four types of challenges, and 5 specific solutions to challenges.

Systematic mapping study (SMS) steps adopted in this study

The distribution of microservices testing Studies

Three identified technologies distribution over publication venues

Microservices testing methods distribution over publication venues

All papers included in the survey：

µFUZZ: Redesign of Parallel Fuzzing using Microservice Architecture

A Novel technique for test case minimization in object oriented testing

Scaling Regression Testing to Large Software Systems

Verification-Aided Regression Testing

Dependent-Test-Aware Regression Testing Techniques

Differential Regression Testing for REST APIs

Automated Capacity Analysis of Limitation-Aware Microservices Architectures

Boosting the Revealing of Detected Violations in Deep Learning Testing: A Diversity-Guided Method

Analyzing Microservice Connectivity with Kubesonde

A Continuous Delivery Pipeline for EA Model Evolution

A quantitative approach for the assessment of microservice architecture deployment alternatives by automated performance testing

A Microservice Regression Testing Selection Approach Based on Belief Propagation

A Reusable Automated Acceptance Testing Architecture for Microservices in Behavior-Driven Development

Adaptive Grey-Box Fuzz-Testing with Thompson Sampling

An Empirical Analysis of Microservices Systems Using Consumer-Driven Contract Testing

An Extensible Fault Tolerance Testing Framework for Microservice-based Cloud Applications

Analyzing regression test selection techniques

Groot: An Event-graph-based Approach for Root Cause Analysis in Industrial Settings

AutoMAP: Diagnose Your Microservice-based Web Applications Automatically

Automated functional and robustness testing of microservice architectures

Automated test-based learning and verification of performance models for microservices systems

Automated Whitebox Fuzz Testing

Automatic Generation of Smoke Test Suites for Kubernetes

Automatic Ex-Vivo Regression Testing of Microservices

Automatic performance monitoring and regression testing during the transition from monolith to microservices

Automation of Regression test in Microservice Architecture

BEACON : Directed Grey-Box Fuzzing with Provable Path Pruning

Bifrost – Supporting Continuous Deployment with Automated Enactment of Multi-Phase Live Testing Strategies

Bunk8s: Enabling Easy Integration Testing of Microservices in Kubernetes

Challenges in Regression Test Selection for End-to-End Testing of Microservice-based Software Systems

Comparison of End-to-End Testing Tools for Microservices: A Case Study

Consumer-Driven Contract Tests for Microservices: A Case Study

Continuous Integration of Applications for ONOS

Delta Debugging Microservice Systems with Parallel Optimization

EMB: A Curated Corpus of Web/Enterprise Applications And Library Support for Software Testing Research

End-to-End Test Coverage Metrics in Microservice Systems: An Automated Approach

Enhance Combinatorial Testing With Metamorphic Relations

Enhancing Fault Injection Testing of Service Systems via Fault-Tolerance Bottleneck

Fitness-guided Resilience Testing of Microservice-based Applications

FUSE: Fault Diagnosis and Suppression with eBPF for Microservices

Fuzz Testing in Practice: Obstacles and Solutions

Hybrid fuzz testing: Discovering software bugs via fuzzing and symbolic execution

Gremlin: Systematic Resilience Testing of Microservices

Greybox Fuzzing of Distributed Systems

Hashing Fuzzing: Introducing Input Diversity to Improve Crash Detection

How effectively does metamorphic testing alleviate the oracle problem?

Test Selection for Unified Regression Testing

Inferring Relations Among Test Programs in Microservices Applications

Large Language Model guided Protocol Fuzzing

A metamorphic testing approach for online testing of service-oriented software applications

Metamorphic Testing for Web System Security

MTTM: Metamorphic Testing for Textual Content Moderation Software

Software Tool to Perform Metamorphic Testing on RESTful Web APIs

Metamorphic Testing on Multi-module UAV Systems

Microlens: A performance analysis framework for microservices using hidden metrics with bpf

Microservice Publishing Technology Based on DevOps Architecture

MICROSERVICES EVOLVING DEVOPS PIPELINES

Microservices: architecting for continuous delivery and DevOps

Microservices Integrated Performance and Reliability Testing

Microservice-tailored Generation of Session-based Workload Models for Representative Load Testing

Microusity: A testing tool for Backends for Frontends (BFF) Microservice Systems

Mutation Testing in Evolving Systems: Studying the Relevance of Mutants to Code Evolution

Mutta: a novel tool for E2E web mutation testing

Mutation Testing for Aspect-Oriented Programs

Practical Mutation Testing at Scale: A view from Google

Pit: a practical mutation testing tool for java

NestFuzz: Enhancing Fuzzing with Comprehensive Understanding of Input Processing Logic

One engine to fuzz'em all: Generic language processor testing with semantic validation

ORCAS: Efficient resilience benchmarking of microservice architectures

ParmeSan: Sanitizer-guided Greybox Fuzzing

PATA: Fuzzing with Path Aware Taint Analysis

Performance Diagnosis in Cloud Microservices Using Deep Learning

Performance Analysis of RESTFUL Web Services and RABBITMQ for Microservices based Systems on Cloud Environment

Preproduction Deploys:Cloud-Native Integration Testing

Record and Replay of Online Traffic for Microservices with Automatic Mocking Point Identification

DevOpRET: Continuous Reliability Testing in DevOps

Regression Greybox Fuzzing

Relation-based test case prioritization for regression testing

More precise regression test selection via reasoning about semantics-modifying changes

Seed Selection for Successful Fuzzing

Selecting and Prioritizing Regression Test Suites by Production Usage Risk in Time-Constrained Environments

Colosseum: Regression Test Prioritization by Delta Displacement in Test Coverage

Smart Greybox Fuzzing

Smoke Testing of Cloud Systems

Solving the Instance Identification Problem in Micro-service Testing

TDD4Fog: A Test-Driven Software Development Platform for Fog Computing Systems

Testing for Event-Driven Microservices Based on Consumer-Driven Contracts and State Models

Testing Graph Searching Based Path Planning Algorithms by Metamorphic Testing

An Optimized Test Case Minimization Technique Using Genetic Algorithm for Regression Testing

UTEMS: A Unit Testing Scheme for Event-driven Microservices

VDF: Targeted Evolutionary Fuzz Testing of Virtual Devices

White-Box Fuzzing RPC-Based APIs with EvoMaster: An Industrial Case Study

Zero-Config Fuzzing for Microservices