Index    ¦   Archives

Kubernetes HPA Autoscaling with Kafka metrics

K8s Autoscaling with Stackdriver and Kafka

Autoscaling is natively supported on Kubernetes. Since 1.7 release, Kubernetes added a feature to scale your workload based on custom metrics. Prior release only supported scaling your apps based on CPU and memory.

Kubernetes 1.7 introduced "Aggregator Layer" which allows Kubernetes to be extended with additional APIs, beyond …


Sharded Mongodb in Kubernetes StatefulSets on GKE

MongoDB in K8s

This blog is going to demonstrate the setup of Sharded MongoDB Cluster on Google Kubernetes Engine. We will use kubernetes StatefulSets feature to deploy mongodb containers.

We need to cover some concepts before we move on to demonstration.

StatefulSets

A StatefulSets is like a Deployment which manages Pods and guarantees …


Patch and Update Table - BigQuery Part-III

Table updation is important when you have data ready inside the table and suddenly you have a requirement of adding more fields in the table to do analysis. In this post, we are going to dive into Streaming feature of BigQuery.


Streaming with Redis - BigQuery Part-II

Streaming helps in pushing our data into BigQuery (short for BQ) and helps in making data available for query without delay of running load jobs. In this post, we are going to dive into Streaming feature of BigQuery.


Export & Load Job with MongoDB - BigQuery Part-I

To get into fundamentals of Google BigQuery and related jobs needed to get your data inside BigQuery system. We are going to use a mongoDB server to export our data and going to import into BigQuery tables. There are several other ways to import data into bigquery.


Installation of VNC server on Ubuntu

This blog is intended for people who wanted to install GUI or desktop environment on linux servers running on cloud and connect.

We are going to use VNC (Virtual Network Computing) protocol for accessing our remote desktop server.

What is VNC ?

Virtual network computing, or VNC, is a graphical desktop …


Managing fleet on Kubernetes

Couple of months ago, we were tackling challenges with scalability of system and were in pursuit of finding right orchestration tools which can help in scaling system quickly. This draft is outline of things we have tried and learned along the way, , most of things might sound familiar to you …


A Practical Guide to Geopy

During my final major academic project, i was working with Twitter data (ie. tweets). I did some research and found out approximately only 1% of all Tweets published on Twitter are geolocated (ie. have location information). This is a very small portion of the Tweets, and i needed almost every …


Get Familiar with Python

Python is a powerful scripting language.

Guide's to Python :

  • Learn about REST architecture.
  • Know and get familiar with Python. [2][2.1][10]
  • Setup virtualenv [3]
  • Get the feel of handling backend. Complete the django tutorial [4] from official site.
  • Know a bit more about django architecture [5][8]
  • Write …

Octopress - Blog Frameworks

Hello, Everyone! This is blog post for helping you setup your own blog using Octopress framework running over Jekyll. I am Summer Intern at Ophio, a New York based company. I have been given a task to set up my blog. My mentor Mr.Saurabh is a Senior Back-end Developer …

© Sunny Kumar. Built using Pelican. Theme by Sunny Kumar on github.

Tweets by Sunny_KrGupta