Vol. 2 No. 2 (2022): Journal of AI-Assisted Scientific Discovery
Articles

Multi-Cluster Mesh Networking for Distributed Applications in EKS

PDF
  • Babulal Shaik
Babulal Shaik
Cloud Solutions Architect at Amazon Web Services, USA
Cover

Published 20-12-2022

Keywords

  • Multi-cluster networking,
  • Kubernetes clusters
Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

How to Cite

[1]
Babulal Shaik, “Multi-Cluster Mesh Networking for Distributed Applications in EKS ”, Journal of AI-Assisted Scientific Discovery, vol. 2, no. 2, pp. 278–298, Dec. 2022, Accessed: Dec. 30, 2024. [Online]. Available: https://scienceacadpress.com/index.php/jaasd/article/view/256

Abstract

The demand for highly available, scalable, and resilient systems has grown substantially in the era of cloud-native applications. Amazon Elastic Kubernetes Service (EKS) provides a robust platform for running containerized applications, offering features that help manage complex, large-scale workloads on AWS. As organizations increasingly adopt Kubernetes, managing multiple clusters within EKS has become more common. However, this introduces new challenges regarding efficient networking, as cross-cluster communication is essential for many distributed applications. Multi-cluster mesh networking has emerged to address these challenges by enabling seamless communication across clusters and improving applications' resilience, scalability, and availability. The concept of a multi-cluster mesh allows for a more reliable & efficient system where resources are shared and managed across multiple clusters, ensuring consistent traffic management and network policies. Organizations can automate and simplify the networking between clusters by using a service mesh like Istio or AWS App Mesh, ensuring that services in different clusters can securely and efficiently communicate with each other. This approach also improves fault tolerance by providing redundant communication paths & balancing traffic in case of failures or high traffic volumes. A multi-cluster mesh can help eliminate single points of failure, ensuring that distributed applications remain operational even during incidents. Furthermore, this approach provides better load balancing by distributing traffic across multiple clusters, reducing the risk of bottlenecks or overloading any single cluster. This enables organizations to scale their applications more effectively and ensures that resources are utilized optimally. The flexibility of a multi-cluster approach allows developers to deploy applications across different regions or availability zones, further enhancing the resilience and geographic distribution of workloads. By integrating multi-cluster mesh networking into EKS, organizations can realize improved application performance, greater fault tolerance, and better resource management. This makes it an ideal solution for organizations looking to enhance their cloud-native applications with Kubernetes.

PDF

Downloads

Download data is not yet available.

References

  1. Farina, G. (2021). Enabling Service Mesh in a Multi-Cloud Architecture (Doctoral dissertation, Politecnico di Torino).
  2. Buchner, P. (2019). From the Cloud to the Edge: An Infrastructure for Cloud & Edge Computing/submitted by Patrick Buchner, BSc.
  3. Beder, A. (2020). Trust Management For A Decentralized Service Exposure Marketplace: A Service Exposure Perspective.
  4. Piscaer, J. (2019). Kubernetes in the enterprise. Bluffton: ActualTech Media.
  5. Putzhuber, W. (2003). From eLearning to Knowledge Management. Graz University of Technology, Austria, pp1-12.
  6. Marino, L. (2020). Dynamic application placement in a Kubernetes multi-cluster environment (Doctoral dissertation, Politecnico di Torino).
  7. Beder, A. A. (2020). Trust Management for A Decentralized Service Exposure Marketplace.
  8. de Albuquerque, G. E. (2019). Plataforma de Controle de Versão e Moderação de Código Orientada a SaaS para o Instituto Federal de Santa Catarina Câmpus São José.
  9. Tamiru, M. A. (2021). Automatic resource management in geo-distributed multi-cluster environments (Doctoral dissertation, Université de Rennes).
  10. Sayfan, G. (2020). Mastering Kubernetes: Level up your container orchestration skills with Kubernetes to build, run, secure, and observe large-scale distributed apps. Packt Publishing Ltd.
  11. Cicchiello, F. (2021). Analysis, modeling and implementation of cost models for a multi-cloud Kubernetes context (Doctoral dissertation, Politecnico di Torino).
  12. Truyen, E., Kratzke, N., Van Landuyt, D., Lagaisse, B., & Joosen, W. (2020). Managing feature compatibility in Kubernetes: Vendor comparison and analysis. Ieee Access, 8, 228420-228439.
  13. Truyen, E., Van Landuyt, D., Preuveneers, D., Lagaisse, B., & Joosen, W. (2019). A comprehensive feature comparison study of open-source container orchestration frameworks. Applied Sciences, 9(5), 931.
  14. Aldwyan, Y. (2021). Intelligent Scaling of Container-based Web Applications in Geographically Distributed Clouds (Doctoral dissertation, University of Melbourne, Parkville, Victoria, Australia).
  15. Saleh, A., & Karslioglu, M. (2021). Kubernetes in Production Best Practices: Build and manage highly available production-ready Kubernetes clusters. Packt Publishing Ltd.
  16. Boda, V. V. R., & Immaneni, J. (2021). Healthcare in the Fast Lane: How Kubernetes and Microservices Are Making It Happen. Innovative Computer Sciences Journal, 7(1).
  17. Immaneni, J. (2021). Using Swarm Intelligence and Graph Databases for Real-Time Fraud Detection. Journal of Computational Innovation, 1(1).
  18. Nookala, G., Gade, K. R., Dulam, N., & Thumburu, S. K. R. (2021). Unified Data Architectures: Blending Data Lake, Data Warehouse, and Data Mart Architectures. MZ Computing Journal, 2(2).
  19. Nookala, G. (2021). Automated Data Warehouse Optimization Using Machine Learning Algorithms. Journal of Computational Innovation, 1(1).
  20. Komandla, V. Strategic Feature Prioritization: Maximizing Value through User-Centric Roadmaps.
  21. Komandla, V. Enhancing Security and Fraud Prevention in Fintech: Comprehensive Strategies for Secure Online Account Opening.
  22. Thumburu, S. K. R. (2021). The Future of EDI Standards in an API-Driven World. MZ Computing Journal, 2(2).
  23. Thumburu, S. K. R. (2021). Optimizing Data Transformation in EDI Workflows. Innovative Computer Sciences Journal, 7(1).
  24. Gade, K. R. (2021). Data-Driven Decision Making in a Complex World. Journal of Computational Innovation, 1(1).
  25. Gade, K. R. (2021). Migrations: Cloud Migration Strategies, Data Migration Challenges, and Legacy System Modernization. Journal of Computing and Information Technology, 1(1).
  26. Katari, A., Muthsyala, A., & Allam, H. HYBRID CLOUD ARCHITECTURES FOR FINANCIAL DATA LAKES: DESIGN PATTERNS AND USE CASES.
  27. Katari, A. Conflict Resolution Strategies in Financial Data Replication Systems.
  28. Nookala, G., Gade, K. R., Dulam, N., & Thumburu, S. K. R. (2020). Automating ETL Processes in Modern Cloud Data Warehouses Using AI. MZ Computing Journal, 1(2).
  29. Boda, V. V. R., & Immaneni, J. (2019). Streamlining FinTech Operations: The Power of SysOps and Smart Automation. Innovative Computer Sciences Journal, 5(1).
  30. Thumburu, S. K. R. (2020). Enhancing Data Compliance in EDI Transactions. Innovative Computer Sciences Journal, 6(1).
  31. Muneer Ahmed Salamkar, et al. The Big Data Ecosystem: An Overview of Critical Technologies Like Hadoop, Spark, and Their Roles in Data Processing Landscapes. Journal of AI-Assisted Scientific Discovery, vol. 1, no. 2, Sept. 2021, pp. 355-77
  32. Muneer Ahmed Salamkar. Scalable Data Architectures: Key Principles for Building Systems That Efficiently Manage Growing Data Volumes and Complexity. Journal of AI-Assisted Scientific Discovery, vol. 1, no. 1, Jan. 2021, pp. 251-70
  33. Muneer Ahmed Salamkar. ETL Vs ELT: A Comprehensive Exploration of Both Methodologies, Including Real-World Applications and Trade-Offs. Distributed Learning and Broad Applications in Scientific Research, vol. 5, Mar. 2019
  34. Naresh Dulam, et al. “Snowflake’s Public Offering: What It Means for the Data Industry ”. Journal of AI-Assisted Scientific Discovery, vol. 1, no. 2, Dec. 2021, pp. 260-81
  35. Naresh Dulam, et al. “Data Lakehouse Architecture: Merging Data Lakes and Data Warehouses”. Journal of AI-Assisted Scientific Discovery, vol. 1, no. 2, Oct. 2021, pp. 282-03
  36. Naresh Dulam, et al. Snowflake Vs Redshift: Which Cloud Data Warehouse Is Right for You? . Distributed Learning and Broad Applications in Scientific Research, vol. 4, Oct. 2018, pp. 221-40
  37. Sarbaree Mishra. “The Age of Explainable AI: Improving Trust and Transparency in AI Models”. Journal of AI-Assisted Scientific Discovery, vol. 1, no. 2, Oct. 2021, pp. 212-35
  38. Sarbaree Mishra, et al. “A New Pattern for Managing Massive Datasets in the Enterprise through Data Fabric and Data Mesh”. Journal of AI-Assisted Scientific Discovery, vol. 1, no. 2, Dec. 2021, pp. 236-59
  39. Sarbaree Mishra. A Distributed Training Approach to Scale Deep Learning to Massive Datasets. Distributed Learning and Broad Applications in Scientific Research, vol. 5, Jan. 2019
  40. Babulal Shaik. Developing Predictive Autoscaling Algorithms for Variable Traffic Patterns . Journal of Bioinformatics and Artificial Intelligence, vol. 1, no. 2, July 2021, pp. 71-90
  41. Babulal Shaik, et al. Automating Zero-Downtime Deployments in Kubernetes on Amazon EKS . Journal of AI-Assisted Scientific Discovery, vol. 1, no. 2, Oct. 2021, pp. 355-77

Most read articles by the same author(s)

Similar Articles

You may also start an advanced similarity search for this article.