Sarwesh Suman – Medium

Published in ITNEXT

·Apr 28, 2020

Elastic(autoscaling) Airflow Cluster on Kubernetes

In this article, I will demonstrate how we can build an Elastic Airflow Cluster which scales-out on high load and scales-in, safely, when the load is below a threshold. Scroll to setup if you want to test it out first. Autoscaling in Kubernetes is supported via Horizontal Pod Autoscaler. Using…

Kubernetes

9 min read

Published in The Startup

·Mar 18, 2020

Scaling Redis Cluster via Kubernetes Horizontal Pod Autoscaler

In this article I will take you through demo of a Horizontally Auto Scaling Redis Cluster with the help of Kubernetes HPA configuration. Note: I am using minikube for demo purpose, but the code and yaml can be used in a Kubernetes cluster with little to none modifications. This is…

Kubernetes

7 min read

Sep 17, 2019

Deploying Redis HA cluster in kubernetes

Redis is an in-memory key value data store which is used as a database, cache and message broker. In this blog we will look at how to deploy Redis HA cluster in kubernetes. Why High Availability? Reliability is one of the key fundamentals for designing a system. …

Kubernetes

7 min read

Aug 24, 2019

Distributing PyTorch model training on minikube with Kubeflow

We know that building a deep learning model for real world problems requires lots of training data and when problems grow in complexity, usually, model’s complexity and training data also grows. …

Kubeflow

5 min read

Jul 20, 2018

Getting Started With NLP

Introduction As the name suggest Natural Language Processing ( NLP ) is processing of languages we human speak to communicate with each other. …

Machine Learning

5 min read