Investigating the Challenges and Solutions of Continuous Performance Assessment in Serverless Architectures with the Use of Technologies Like AWS Lambda and Dynatrace
Keywords:
Continuous performance monitoring, serverless architectures, AWS LambdaAbstract
While maximizing speed is vital in the fast changing field of event-driven government applications, it presents different challenges for serverless architectures. Eliminating the necessity for maintaining the underlying infrastructure, serverless architectures—shown as AWS Lambda—show great scalability and cost-effectiveness. This abstraction reduces performance monitoring, therefore impeding real-time defect diagnosis. Tools like Dynatrace join this field with advanced capabilities to provide understanding of all facets of serverless operations. They help to clarify the complexities of tracking executions across many services, controlling cold beginnings, and monitoring autonomous growing functions. Ensuring a perfect user experience and optimizing resource efficiency provide twin challenges in investigating continuous performance monitoring within serverless architectures. This work attempts to clarify new monitoring techniques and tools addressing changing properties of serverless systems.
Downloads
References
McGrath, G., & Brenner, P. R. (2017, June). Serverless computing: Design, implementation, and performance. In 2017 IEEE 37th International Conference on Distributed Computing Systems Workshops (ICDCSW) (pp. 405-410). IEEE.
Benedict, S. (2021). Performance issues and monitoring mechanisms for serverless IoT applications—an exploratory study. In Smart Computing Techniques and Applications: Proceedings of the Fourth International Conference on Smart Computing and Informatics, Volume 1 (pp. 165-174). Springer Singapore.
Bardsley, D., Ryan, L., & Howard, J. (2018, September). Serverless performance and optimization strategies. In 2018 IEEE International Conference on Smart Cloud (SmartCloud) (pp. 19-26). IEEE.
Mahmoudi, N., & Khazaei, H. (2020). Performance modeling of serverless computing platforms. IEEE Transactions on Cloud Computing, 10(4), 2834-2847.
Shahidi, N., Gunasekaran, J. R., & Kandemir, M. T. (2021, November). Cross-platform performance evaluation of stateful serverless workflows. In 2021 IEEE International Symposium on Workload Characterization (IISWC) (pp. 63-73). IEEE.
Palade, A., Kazmi, A., & Clarke, S. (2019, July). An evaluation of open source serverless computing frameworks support at the edge. In 2019 IEEE World Congress on Services (SERVICES) (Vol. 2642, pp. 206-211). IEEE.
Mohanty, S. K., Premsankar, G., & Di Francesco, M. (2018, December). An evaluation of open source serverless computing frameworks. In IEEE International Conference on Cloud Computing Technology and Science (pp. 115-120). IEEE.
Lloyd, W., Ramesh, S., Chinthalapati, S., Ly, L., & Pallickara, S. (2018, April). Serverless computing: An investigation of factors influencing microservice performance. In 2018 IEEE international conference on cloud engineering (IC2E) (pp. 159-169). IEEE.
Sbarski, P., & Kroonenburg, S. (2017). Serverless architectures on AWS: with examples using Aws Lambda. Simon and Schuster.
McGrath, G. (2017). Serverless Computing: Applications, Implementation, and Performance. University of Notre Dame.
Rodriguez-Sanchez, M. (2015). Cloud native Application Development-Best Practices: Studying best practices for developing cloud native applications, including containerization, microservices, and serverless computing. Distributed Learning and Broad Applications in Scientific Research, 1, 18-27.
Anderson, T. E., Dahlin, M. D., Neefe, J. M., Patterson, D. A., Roselli, D. S., & Wang, R. Y. (1995, December). Serverless network file systems. In Proceedings of the fifteenth ACM symposium on Operating systems principles (pp. 109-126).
Dean, J., Harrison, A., Lass, R. N., Macker, J., Millar, D., & Taylor, I. (2011). Client/server messaging protocols in serverless environments. Journal of network and computer applications, 34(4), 1366-1379.
Gedik, B., & Liu, L. (2005). A scalable peer-to-peer architecture for distributed information monitoring applications. IEEE Transactions on Computers, 54(6), 767-782.
Chen, B. (2004). A serverless, wide-area version control system (Doctoral dissertation, Massachusetts Institute of Technology).
Katari, A., Muthsyala, A., & Allam, H. HYBRID CLOUD ARCHITECTURES FOR FINANCIAL DATA LAKES: DESIGN PATTERNS AND USE CASES.
Katari, A. Conflict Resolution Strategies in Financial Data Replication Systems.
Boda, V. V. R., & Immaneni, J. (2021). Healthcare in the Fast Lane: How Kubernetes and Microservices Are Making It Happen. Innovative Computer Sciences Journal, 7(1).
Immaneni, J. (2021). Using Swarm Intelligence and Graph Databases for Real-Time Fraud Detection. Journal of Computational Innovation, 1(1).
Gade, K. R. (2021). Data-Driven Decision Making in a Complex World. Journal of Computational Innovation, 1(1).
Gade, K. R. (2021). Migrations: Cloud Migration Strategies, Data Migration Challenges, and Legacy System Modernization. Journal of Computing and Information Technology, 1(1).
Thumburu, S. K. R. (2021). Transitioning to Cloud-Based EDI: A Migration Framework, Journal of Innovative Technologies, 4(1).
Thumburu, S. K. R. (2021). Integrating Blockchain Technology into EDI for Enhanced Data Security and Transparency. MZ Computing Journal, 2(1).
Komandla, V. Strategic Feature Prioritization: Maximizing Value through User-Centric Roadmaps.
Komandla, V. Enhancing Security and Fraud Prevention in Fintech: Comprehensive Strategies for Secure Online Account Opening.
Nookala, G., Gade, K. R., Dulam, N., & Thumburu, S. K. R. (2021). Unified Data Architectures: Blending Data Lake, Data Warehouse, and Data Mart Architectures. MZ Computing Journal, 2(2).
Nookala, G. (2021). Automated Data Warehouse Optimization Using Machine Learning Algorithms. Journal of Computational Innovation, 1(1).
Nookala, G., Gade, K. R., Dulam, N., & Thumburu, S. K. R. (2020). Data Virtualization as an Alternative to Traditional Data Warehousing: Use Cases and Challenges. Innovative Computer Sciences Journal, 6(1).
Thumburu, S. K. R. (2020). Integrating SAP with EDI: Strategies and Insights. MZ Computing Journal, 1(1).
Thumburu, S. K. R. (2020). Interfacing Legacy Systems with Modern EDI Solutions: Strategies and Techniques. MZ Computing Journal, 1(1).
Sarbaree Mishra. “Moving Data Warehousing and Analytics to the Cloud to Improve Scalability, Performance and Cost-Efficiency”. Distributed Learning and Broad Applications in Scientific Research, vol. 6, Feb. 2020
Sarbaree Mishra, et al. “Training AI Models on Sensitive Data - the Federated Learning Approach”. Distributed Learning and Broad Applications in Scientific Research, vol. 6, Apr. 2020
Sarbaree Mishra. “Automating the Data Integration and ETL Pipelines through Machine Learning to Handle Massive Datasets in the Enterprise”. Distributed Learning and Broad Applications in Scientific Research, vol. 6, June 2020
Sarbaree Mishra. “The Age of Explainable AI: Improving Trust and Transparency in AI Models”. Journal of AI-Assisted Scientific Discovery, vol. 1, no. 2, Oct. 2021, pp. 212-35
Sarbaree Mishra, et al. “A New Pattern for Managing Massive Datasets in the Enterprise through Data Fabric and Data Mesh”. Journal of AI-Assisted Scientific Discovery, vol. 1, no. 2, Dec. 2021, pp. 236-59
Naresh Dulam, et al. “Data As a Product: How Data Mesh Is Decentralizing Data Architectures”. Distributed Learning and Broad Applications in Scientific Research, vol. 6, Apr. 2020
Naresh Dulam, et al. “Data Mesh in Practice: How Organizations Are Decentralizing Data Ownership ”. Distributed Learning and Broad Applications in Scientific Research, vol. 6, July 2020
Naresh Dulam, et al. “Snowflake’s Public Offering: What It Means for the Data Industry ”. Journal of AI-Assisted Scientific Discovery, vol. 1, no. 2, Dec. 2021, pp. 260-81
Naresh Dulam, et al. “Data Lakehouse Architecture: Merging Data Lakes and Data Warehouses”. Journal of AI-Assisted Scientific Discovery, vol. 1, no. 2, Oct. 2021, pp. 282-03
Naresh Dulam, et al. “The AI Cloud Race: How AWS, Google, and Azure Are Competing for AI Dominance ”. Journal of AI-Assisted Scientific Discovery, vol. 1, no. 2, Dec. 2021, pp. 304-28
Muneer Ahmed Salamkar. Next-Generation Data Warehousing: Innovations in Cloud-Native Data Warehouses and the Rise of Serverless Architectures. Distributed Learning and Broad Applications in Scientific Research, vol. 5, Apr. 2019
Muneer Ahmed Salamkar. Real-Time Data Processing: A Deep Dive into Frameworks Like Apache Kafka and Apache Pulsar. Distributed Learning and Broad Applications in Scientific Research, vol. 5, July 2019
Muneer Ahmed Salamkar, and Karthik Allam. “Data Lakes Vs. Data Warehouses: Comparative Analysis on When to Use Each, With Case Studies Illustrating Successful Implementations”. Distributed Learning and Broad Applications in Scientific Research, vol. 5, Sept. 2019
Muneer Ahmed Salamkar. Data Modeling Best Practices: Techniques for Designing Adaptable Schemas That Enhance Performance and Usability. Distributed Learning and Broad Applications in Scientific Research, vol. 5, Dec. 2019
Muneer Ahmed Salamkar. Batch Vs. Stream Processing: In-Depth Comparison of Technologies, With Insights on Selecting the Right Approach for Specific Use Cases. Distributed Learning and Broad Applications in Scientific Research, vol. 6, Feb. 2020
Babulal Shaik. Automating Compliance in Amazon EKS Clusters With Custom Policies . Journal of Artificial Intelligence Research and Applications, vol. 1, no. 1, Jan. 2021, pp. 587-10
Babulal Shaik. Developing Predictive Autoscaling Algorithms for Variable Traffic Patterns . Journal of Bioinformatics and Artificial Intelligence, vol. 1, no. 2, July 2021, pp. 71-90
Babulal Shaik, et al. Automating Zero-Downtime Deployments in Kubernetes on Amazon EKS . Journal of AI-Assisted Scientific Discovery, vol. 1, no. 2, Oct. 2021, pp. 355-77