Microservice (MS) architecture has become a popular paradigm in software engineering and has been embraced in the industry (e.g., Amazon, Netflix) for cloud-based applications with crucial performance requirements. Surprisingly, assessing how the MS designs affect performance is still a challenging issue, which is generally tackled by extensive and expensive profiling. In this paper, we propose μP , a novel development framework for MS applications where performance can be predicted by design. μP offers an API that automatically generates a per-formance model based on Layered Queuing Networks (LQNs) without requiring any development effort beyond writing the actual system code. The model can then be queried to predict performance metrics such as response time and utilization of individual microservices. We validate μP on four benchmarks taken from the literature. The results show the effectiveness of μP in accurately predicting performance due to increasing user load, vertical and horizontal scaling. We report prediction errors for response times consistently lower than 10% across a wide range of operating conditions.

μP: A Development Framework for Predicting Performance of Microservices by Design

Incerto, Emilio;Tribastone, Mirco
2023-01-01

Abstract

Microservice (MS) architecture has become a popular paradigm in software engineering and has been embraced in the industry (e.g., Amazon, Netflix) for cloud-based applications with crucial performance requirements. Surprisingly, assessing how the MS designs affect performance is still a challenging issue, which is generally tackled by extensive and expensive profiling. In this paper, we propose μP , a novel development framework for MS applications where performance can be predicted by design. μP offers an API that automatically generates a per-formance model based on Layered Queuing Networks (LQNs) without requiring any development effort beyond writing the actual system code. The model can then be queried to predict performance metrics such as response time and utilization of individual microservices. We validate μP on four benchmarks taken from the literature. The results show the effectiveness of μP in accurately predicting performance due to increasing user load, vertical and horizontal scaling. We report prediction errors for response times consistently lower than 10% across a wide range of operating conditions.
2023
979-8-3503-0481-7
Microservice-based applications , Performance of Systems , Performance by Design , Automated Modeling Techniques
File in questo prodotto:
File Dimensione Formato  
P_A_Development_Framework_for_Predicting_Performance_of_Microservices_by_Design.pdf

non disponibili

Tipologia: Versione Editoriale (PDF)
Licenza: Copyright dell'editore
Dimensione 1.43 MB
Formato Adobe PDF
1.43 MB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.11771/26360
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
social impact