KubeBlogs - DevOps and Cloud content
  • DevOps
  • Kubernetes
  • Cloud
  • Python
  • Tools
  • LLM
  • KubeNine™
Sign in Subscribe
Rapid UI Prototyping with Python Streamlit: Audio Transcription, End-to-End

Rapid UI Prototyping with Python Streamlit: Audio Transcription, End-to-End

Introduction Podcasts, video calls, and voice calls produces hours of speech every day. Turning that speech into text is now routine for meetings, customer-support calls, and more. A simple audio to text tool can help us capture conversations on meetings, phone or our smart watch - once recorded we can
25 Jun 2025 3 min read
Securely Accessing AWS Resources from GitHub Actions using OpenID Connect (OIDC)

Securely Accessing AWS Resources from GitHub Actions using OpenID Connect (OIDC)

Introduction Hardcoding AWS credentials into CI/CD pipelines is one of the most common mistakes teams make—and one of the easiest to avoid. In this blog, you’ll learn how to connect GitHub Actions with AWS using OpenID Connect (OIDC), a method that skips access keys entirely. Instead of
19 Jun 2025 5 min read
Add Blazing Fast Search to Your Django Site with Algolia

Add Blazing Fast Search to Your Django Site with Algolia

Introduction Most web applications struggle with search functionality as they scale. Users expect instant, accurate results with typo tolerance and intelligent filtering capabilities that traditional database queries simply cannot deliver efficiently. Building these features from scratch requires significant development resources and ongoing infrastructure management. Even with proper indexing, SQL queries
17 Jun 2025 3 min read
How a Simple Open Source Tool Drastically Improved Our Time to Ship GitHub Actions

How a Simple Open Source Tool Drastically Improved Our Time to Ship GitHub Actions

Introduction Every DevOps team knows the frustration: you push a change to your GitHub Actions workflow, then wait several minutes for the pipeline to execute, fail, and force another round of commits. And then it goes on in a loop. At KubeNine, we encountered this same delay while iterating on
12 Jun 2025 4 min read
Simplifying AWS CloudTrail Log Analysis using NLP

Simplifying AWS CloudTrail Log Analysis using NLP

Introduction Cloud security auditing is critical but often tedious and time-consuming. AWS CloudTrail logs every API call and user activity, offering a detailed audit trail. But combing through these logs manually or writing complex CloudWatch Insights queries is a painful and error-prone task. We at KubeNine have built an AI-powered
09 Jun 2025 3 min read
Why We Chose Vaultwarden for Password Management — And Why It Might Work for You

Why We Chose Vaultwarden for Password Management — And Why It Might Work for You

Introduction When we started looking for password managers for our DevOps team, Bitwarden Cloud was a natural first stop. It’s trusted, secure, and user-friendly — but it came with limitations that didn’t sit well with our priorities as a self-hosting, cost-conscious DevOps consultancy. * We don’t do black boxes:
06 Jun 2025 3 min read
How This AWS Architecture Keeps Notifying You Until You Fix It - Repeated Alarm

How This AWS Architecture Keeps Notifying You Until You Fix It - Repeated Alarm

By default, Amazon CloudWatch Alarms send a notification only when the alarm changes state — for example, from OK to ALARM. If the alarm remains in the ALARM state, no additional messages are sent. This can be a problem in production environments or for support teams who rely on timely updates
04 Jun 2025 9 min read
Ship Logs from EKS to Cloudwatch using Fluent-Bit

Ship Logs from EKS to Cloudwatch using Fluent-Bit

Introduction When running workloads on Kubernetes, collecting logs from your applications and system components is a basic necessity. In this guide, we’ll show how to use Fluent Bit to gather logs from different sources in a Kubernetes cluster and send them to Amazon CloudWatch Logs. Fluent Bit is a
02 Jun 2025 9 min read
Automate GCP Billing Notifications using Airflow

Automate GCP Billing Notifications using Airflow

Introduction Staying on top of your cloud spendings saves you from disasters. For startups and fast-moving teams, not knowing what you're spending until it’s too late can blow up budgets and cause panic. We have been situations where we created services and let them running for days
27 May 2025 3 min read
A simple framework to help you Rightsize your cloud resources!

A simple framework to help you Rightsize your cloud resources!

Introduction I’ve learnt a few things about autoscaling and rightsizing that tend to work well in most scenarios. No guarantee they’ll fit your use case exactly, but they can serve as helpful references to get started. I’ve been in situations where I downsized resources for a customer
23 May 2025 3 min read
Let Your Kubernetes Workloads Sleep: Using Snorlax to Cut Non-Prod Cluster Costs

Let Your Kubernetes Workloads Sleep: Using Snorlax to Cut Non-Prod Cluster Costs

Non-production workloads running on Kubernetes need not be up 24/7. In order to cut cost we can easily shut down a lot of them during non-work hours or on weekends. This small change can add to significant cost saving in large environments. Snorlax helps you do exactly that. By
09 May 2025 5 min read
Why HTTPS Matters and How to Enable It Using Certbot

Why HTTPS Matters and How to Enable It Using Certbot

Introduction Securing your website is no longer optional, it’s a fundamental requirement. If your site is still operating over HTTP, it’s time to make the switch to HTTPS. This not only ensures data transmitted between your users and server is encrypted and secure, but also strengthens user trust,
01 May 2025 3 min read
Stop Overpaying for AWS CloudWatch: Metric Optimization Tips

Stop Overpaying for AWS CloudWatch: Metric Optimization Tips

Introduction AWS Cloudwatch is the default monitoring service on AWS. When you’re using AWS, Cloudwatch is part of the package - you’ll automatically get default metrics when you asked for them or not. Things are good as long as you’re using these default metrics, but when you
24 Apr 2025 4 min read
Wait4X: The Elegant Service Readiness Notifier for DevOps

Wait4X: The Elegant Service Readiness Notifier for DevOps

Introduction In modern container-based architectures, one challenge is ensuring that services are ready before their dependencies attempt to use them. Wait4X is a handy CLI tool which solves this problem with a simple notification system. What Makes Wait4X Special? Unlike complex monitoring tools, Wait4X does one thing extremely well -
19 Apr 2025 4 min read
Building Autonomous AI Teams with CAMEL-AI

Building Autonomous AI Teams with CAMEL-AI

Introduction AI has transformed from a buzzword into an essential toolkit. AI capabilities continue to expand at a mind-boggling pace. While AI Agents are great, do you know what's even better? AI Workforces. What if you could simply create multiple agents with different roles and responsibilities? These agents
15 Apr 2025 9 min read
6 Things You’re Probably Doing Wrong in Prometheus Monitoring

6 Things You’re Probably Doing Wrong in Prometheus Monitoring

Prometheus is an incredibly powerful tool for monitoring your systems. Its flexible data model and expressive query language, PromQL, make it one of the most popular choices in the observability world. But — that flexibility comes at a cost. When you're just starting out with Prometheus, it's
11 Apr 2025 8 min read
Python’s Biggest Bottleneck Just Got Optional: Meet the GIL-Free Era!

Python’s Biggest Bottleneck Just Got Optional: Meet the GIL-Free Era!

Are you experiencing performance bottlenecks in your Python applications? Have you wondered why your multi-threaded Python code doesn't fully utilize all CPU cores? The answer lies in Python's Global Interpreter Lock (GIL). For years, this mechanism has been a significant limitation for CPU-bound tasks in Python,
07 Apr 2025 7 min read
How to Use ECS Exec to Access Fargate Containers with Terraform

How to Use ECS Exec to Access Fargate Containers with Terraform

Introduction Is it even possible to exec into a running container in ECS? It definitely is - but it’s not straightforward to setup. ECS Exec lets you connect to your containers on demand using the AWS CLI, giving you a way to inspect, debug, and fix issues inside your
26 Mar 2025 8 min read
Test your LLM applications right!

Test your LLM applications right!

What’s the biggest challenge when building applications, whether they’re web-based, native, LLM-powered, or anything else? Testing! Every time you make a change, you need to ensure the application still functions smoothly and that your new features haven’t broken any part of the flow. To simplify this, we
18 Mar 2025 6 min read
Using port-forward too often? KubeVPN Can help!

Using port-forward too often? KubeVPN Can help!

Introduction If you’ve worked with building or deploying anything on Kubernetes then you must have had the need to connect to a service running on a remote kubernetes cluster from your local system. This is often needed for debugging and testing. kubectl port-forward is the standard method used to
13 Mar 2025 4 min read
Automating Cloudflare DNS Management with Terraform

Automating Cloudflare DNS Management with Terraform

Why use terraform for managing DNS records? If you're responsible for managing DNS records on Cloudflare across multiple domains, you know how repetetive it can be to keep updating DNS records all the time. You log into the Cloudflare dashboard, go to the DNS settings, and manually change
11 Mar 2025 4 min read
Supercharging AI IDEs with Model Context Protocol (MCP)

Supercharging AI IDEs with Model Context Protocol (MCP)

The past few months have been crazy. We see new AI innovations coming in every day. The amount of transformation is going to change the way we are used to doing things for the better. At KubeNine, we have been constantly adapting to the change - trying to keep up
07 Mar 2025 3 min read
Why Google CloudRun is not an alternative for Amazon ECS!

Why Google CloudRun is not an alternative for Amazon ECS!

Introduction ECS is a popular container orchestration service provided by AWS. You can run any application on ECS as long as you can containerise it. HTTP based applications or applications that consume messages from a queue - any use case - it just works, with no drama. When evaluating a
05 Mar 2025 4 min read
VPC in AWS and GCP

VPC in AWS and GCP: How are they fundamentally different?

Introduction Google Cloud Platform (GCP) and Amazon Web Services (AWS) both offer VPCs, but they handle network scope, connectivity, and scaling in different ways. It’s important to know these differences when you’re building apps on these platforms. You might have heard often - “I know AWS - I
01 Mar 2025 6 min read
Build a Simple S3 Storage Browser in React

Build a Simple S3 Storage Browser in React

It’s almost impossible to build a meaningful web application without object storage these days. Often in our apps we require access to files on s3 bucket. Working with AWS S3 often requires building interfaces to provide secure and accessible ways for interacting with stored files. However, creating such interfaces
21 Feb 2025 4 min read
How We Leveraged Pydantic and Llama index for Data Extraction from unstructured files

How We Leveraged Pydantic and Llama index for Data Extraction from unstructured files

Introduction Extracting information from PDF files is a common use case. Often we want to extract structured data from PDF files such as resumes, invoices, or reports. Extracting relevant information while maintaining a consistent structure is crucial for automation and further analysis. By leveraging LLMs and Pydantic, developers can transform
07 Feb 2025 3 min read
KubeBlogs: Django Lifecycle Hooks

Django Lifecycle Hooks: A better alternative to signals

As developers, we often encounter scenarios where certain actions need to be performed whenever something happens to our models. Whether it’s adding new data, updating existing records, or deleting something from the database. For years, Django signals have been the go-to solution for handling these kinds of requirements. They’
06 Feb 2025 4 min read
KubeBlogs: Understanding Cloudflare Tunnel and Reverse Proxy

All you need to know about Cloudflare tunnel

Introduction Imagine this: You're working on a cool new website or app on your computer, and you can’t wait to show it to a client or get some feedback from a team member. But here's the catch—you don’t want the hassle of setting
01 Feb 2025 3 min read
qb9.in

QB9: Your global bookmark on the internet

Ever been stuck searching for the right document or webpage, wasting time and energy clicking through tabs and folders? Picture this: you’re checking into a hotel, and the receptionist asks for your ID. It’s stored in your Google Drive, but after a frustrating few minutes of digging through
30 Jan 2025 3 min read
KubeBlogs: All you need to know about the Bottlerocket Operating System

All you need to know about the Bottlerocket Operating System

Introduction Bottlerocket OS has been promoted by AWS for a while now. In fact it is the recommended default OS for EKS worker nodes. They also use the same OS for ECS as well. Although by design bottlerocket seems extremely promising but we are yet to see any official benchmark
21 Jan 2025 2 min read
KubeBlogs: Reduce Cost and Improve Security with Amazon VPC Endpoints

Reduce Cost and Improve Security with Amazon VPC Endpoints

What If I Told You That You Could Reduce Your AWS Costs by Up to 90%? No, you’re not wrong—that’s entirely possible. For example, when working with S3 buckets, you can cut costs by as much as 90%. So, you might be wondering: what’s the secret
13 Jan 2025 7 min read
KubeBlogs: Run streamlit reliably in production using supervisor!

How to run Streamlit reliably in production using supervisor!

Streamlit is widely used by Python developers for rapid prototyping as well as running real production applications. Have you ever faced a situation where your Streamlit application suddenly stops working? Whether due to crashes or server issues. Most developers run streamlit using tmux or nohup - which work - but
09 Jan 2025 3 min read
KubeBlogs: Authentication with OAuth2-Proxy and NGINX Ingress on Kubernetes

Adding Authentication to Any App in Minutes using OAuth2 Proxy!

Introduction Imagine this—you've built an amazing application, but there's one problem: it doesn’t support authentication out of the box. Now you need to secure it without rewriting code or building a custom auth system. That’s where OAuth2-Proxy can help. It’s a straightforward
02 Jan 2025 4 min read
Jenkins or GitHub Actions? Deciding the Right CI/CD Tool for Your Workflow

Jenkins or GitHub Actions? Deciding the Right CI/CD Tool for Your Workflow

Introduction Continuous Integration and Delivery is a key part of any software application. Be it a mobile app, a backend app or a website - everything requires CI/CD to make things easier for everyone. From testing and building code to deploying it across environments, CI/CD tools help simplify
31 Dec 2024 10 min read
Breaking free from Servers: Serverless RDBMS without the headaches

Breaking free from Servers: Serverless RDBMS without the headaches

Introduction Sometimes, you might set up an RDS instance that gets queried only a few times a day. For example, QA instances used by testing teams during office hours often stay idle for the rest of the day, yet you still have to pay for the entire instance. This can
30 Dec 2024 5 min read
KubeBlogs: AWS EKS Auto Mode

EKS Auto Mode launched recently - is it worth the hype?

Introduction Running Kubernetes in production can be hard. Even with the managed options Kubernetes isn’t a bed of roses. AWS recently launched EKS Auto Mode which aims to offload some pain. While the features offered by the auto mode can be useful, almost all of them were already used
25 Dec 2024 5 min read
How we use airflow to optimize our DevOps workflow

How we use Airflow to optimize our DevOps workflow.

Introduction Apache Airflow is a powerful tool for automating workflows and managing complex processes effectively. In DevOps, tasks like token validation, Kubernetes configuration management, and updating secrets are often repetitive and time-consuming. With Airflow, we replaced manual work with automated workflows, saving time and reducing errors. We used chatgpt to
20 Dec 2024 6 min read
AWS KMS MasterClass - Secure AWS services using AWS KMS

AWS KMS MasterClass - Secure AWS services using AWS KMS

In a world where data breaches and unauthorized access are just a news headline away, encryption isn't optional—it's a must-have. But here's the thing: encryption is only as good as the keys securing it. Imagine locking your most valuable belongings in a high-tech
09 Dec 2024 9 min read
Django Development with Cookiecutter

Accelerate Django Development with Cookiecutter

As a Django developer, you’ve received a PRD to start building a brand-new product from scratch. Your first task? Project initialization and a deployment checklist. Sounds familiar, right? It's the same routine of configurations you’ve handled in your recent projects, just with a few tweaks for
04 Dec 2024 4 min read
Set Up EC2 Memory Monitoring with Amazon CloudWatch Agent and Terraform

Set Up EC2 Memory Monitoring with Amazon CloudWatch Agent and Terraform

Introduction Amazon EC2 is a widely used service for running applications in the cloud. Keeping track of its performance is important to make sure your applications run without issues. EC2 provides metrics like CPU usage and network activity by default. However, memory usage is not included, and this can be
27 Nov 2024 5 min read
Secrets Management in Kubernetes with AWS and External Secrets Operator

Simplifying Secret Management in Kubernetes with AWS and External Secrets Operator

Managing sensitive information, like passwords and API keys, in Kubernetes can be challenging. You want to keep your secrets secure while still making them available to your applications. In this guide, we'll walk you through how to connect AWS Secrets Manager with your Kubernetes cluster using the External
19 Nov 2024 7 min read
Top 10 tools for effortless Kubernetes management

Beyond the Basics: Tools That Make Kubernetes Management Effortless

Kubernetes is a powerful platform for container orchestration, but managing it effectively requires the right set of tools. These tools help to simplify tasks such as deploying applications, managing permissions, scaling services, and ensuring security. Let’s explore ten essential tools that can greatly simplify Kubernetes management. 1. Stern Stern
13 Nov 2024 5 min read
Loki vs. Elasticsearch: Choosing the Right Logging System for You

Loki vs. Elasticsearch: Choosing the Right Logging System for You

Logging systems are vital tools that help us understand what's happening inside our applications. They record events, errors, and other important information, making it easier to troubleshoot problems, monitor performance, and keep things running smoothly. In this post, we'll compare two popular logging systems: Grafana Loki
08 Nov 2024 8 min read
KubeBlogs : Integrate Slack Notifications into ArgoCD

Integrating Slack Notifications into ArgoCD for Better Workflow

ArgoCD is a powerful tool for managing Kubernetes applications through GitOps principles, ensuring that your deployments are consistent and reliable. Slack, on the other hand, is a widely-used communication platform that enhances team collaboration. By integrating Slack with ArgoCD, you can receive real-time notifications about your deployment statuses directly in
04 Nov 2024 8 min read
Simplify Database Migrations and Management using Python with SQLAlchemy and Alembic

Simplify Database Migrations and Management using Python with SQLAlchemy and Alembic

Consider a scenario where you’re building a user management system for a web application. Initially, you might only need to store simple details like names and emails. But as your application expands, so does your database’s complexity. You might want to add features such as user preferences, roles,
30 Oct 2024 10 min read
Build secure Internal applications: How to Integrate OAuth2 in Your Streamlit Apps

Build secure Internal applications: How to Integrate OAuth2 in Your Streamlit Apps

Streamlit makes it super easy to build apps superfast. But what if you want to add a simple login system that works with your company’s existing SSO, like Microsoft or Google? You can still build awesome internal tools fast while making sure only the right people have access. With
29 Oct 2024 5 min read
Streamlit: Stream Logs to AWS CloudWatch

Streamlit in Production: How to Stream Logs to AWS CloudWatch

If you’re running a streamlit application in production, you might want to ship logs generated by it to cloudwatch. If you’re using ECS then it might be simple but if your have deployed your app on an EC2 instance or Kubernetes then it might not be that straightforward.
24 Oct 2024 4 min read
Streamlit Authentication

Streamlit Authentication Made Simple: Step-by-Step Guide

Streamlit can help us quickly build a fully functional web application. It’s really effective in prototyping as well as building full fledged internal apps. Recently we had a use case where we had a requirement of adding basic authentication in front of the streamlit app to prevent unauthorized access
22 Oct 2024 4 min read
Docker - KubeBlogs

Reduce docker image size from 1GB to 150mb | Method to optimize docker images

Docker makes it easy to package software, but if you're not careful, your images can get bloated. Big images mean slower downloads, delayed deployments, and longer startup times—nobody wants that. The main problem? We often add stuff we don't need: source code, build tools, and
18 Oct 2024 9 min read
The art of zero-downtime in kubernetes : Deployment Strategies

The art of zero-downtime in kubernetes : Deployment Strategies

Introduction Imagine you're running a popular online service, and suddenly, during an update, your application goes down. Users can't access your service, and with each passing minute, you're losing revenue and customer trust. This scenario is every developer's nightmare. Downtime not only
16 Oct 2024 11 min read
How to Install Loki using helm!

How to Install Loki using helm!

In the previous blog, we covered everything about Loki, from its components to its architecture, explaining how it works and how it efficiently compresses logs. If you have not read the blog check it out here: https://www.kubeblogs.com/all-you-need-to-know-about-loki/ Now that you have a solid understanding of Loki’
09 Oct 2024 4 min read
All you need to know About Loki!

All you need to know About Loki!

At KubeNine, we ensure that our customers log well and log right! Logs are crucial because they keep track of everything your applications do, from errors and warnings to user activities and system events. However, managing all these logs can take up a lot of resources and make it hard
09 Oct 2024 9 min read
Manage your kubernetes secrets securely, directly from the web browser!

Manage your kubernetes secrets securely, directly from the web browser!

Managing secrets in Kubernetes can be a real headache. If you've ever struggled with keeping environment variables secure and up-to-date across multiple clusters, I totally get it. Many of us have faced the hassle of manual secret management, and it's time we found a better way.
05 Oct 2024 5 min read
Why AWS should pre-install the EBS driver on EKS!

Why AWS should pre-install the EBS driver on EKS!

Introduction: I have been using EKS for over 3 years now and I have never understood why AWS decided not to have the EBS storage driver pre-installed on a new cluser. Storage is like oxygen - I never understood why something as basic as that shouldn’t be available pre-installed.
01 Oct 2024 4 min read
The Only Blog You’ll Ever Need to Master Kubernetes Health Checks

The Only Blog You’ll Ever Need to Master Kubernetes Health Checks

Introduction Kubernetes is one of the most powerful tools for orchestrating containerized applications. When it comes to healthchecks Kubernetes offers multiple options. Its very important to understand these healthcecks so that you can deploy a resilient and highly available application. Kubernetes healthchecks can be confusing. For most beginners, all the
27 Sep 2024 5 min read
How nginx-image-resizer Simplifies Image Handling for Your Web Apps

How nginx-image-resizer Simplifies Image Handling for Your Web Apps

Images are a crucial part of any website. They make content more engaging and visually appealing. But if these images aren’t served fast, they can slow down your site and frustrate users. Imagine visiting a site where images take forever to load or don't display correctly on
16 Sep 2024 6 min read
How to Enhance Cloud Security Audits with Prowler: Step-by-Step Guide

How to Enhance Cloud Security Audits with Prowler: Step-by-Step Guide

Introduction I bumped across Prowler (https://github.com/prowler-cloud/prowler) when my team was looking for a tool using which we could write custom checks to ensure security of our account. Prowler is an open-source security tool designed to help you assess, audit, and improve the security of your AWS,
12 Sep 2024 5 min read
Use your own NAT Server to SAVE UPTO 40$ / MONTH

Use your own NAT Server to SAVE UPTO 40$ / MONTH

Introduction Setting up a Virtual Private Cloud (VPC) in AWS can be challenging, especially when you have services in both public and private subnets. Recently, I worked on a project that required exactly this. We had a mix of services, some accessible from the internet and others tucked away in
10 Sep 2024 6 min read
Use AWS Config to enforce compliance policies

Use AWS Config to enforce compliance policies

What is AWS Config? Did you know you can track every change in your AWS account, enforce compliance, and spot issues before they become problems. AWS Config gives you the power to monitor and manage your resources, ensuring they’re secure and compliant. AWS Config helps you keep an eye
06 Sep 2024 3 min read
How does SAML Authentication Work?

How does SAML Authentication Work?

Recently, I joined KubeNine as a DevOps engineer. As part of the onboarding process, I received a work email and access to a company dashboard that provides links to all the tools I need. This dashboard is crucial because it connects me to the various services we use, such as
03 Sep 2024 4 min read
Why should you consider running your own in-house RPC Node?

Why should you consider running your own in-house RPC Node?

As the blockchain ecosystem continues to change with every passing day, the need for a simple and reliable infrastructure becomes more crucial. One way to achieve this is by running your own in-house RPC (Remote Procedure Call) node. Having your own RPC node ensures that you have faster access to
27 Aug 2024 5 min read
Self-Hosted GitHub Actions Runner on Kubernetes Using Helmfile

Self-Hosted GitHub Actions Runner on Kubernetes Using Helmfile

Introduction When it comes to automating your CI/CD pipelines, GitHub Actions is a great tool. But what if you want more control over your environment? That's where a self-hosted GitHub Actions runner comes in. Self-hosted github actions runner allows you to run the builds inside your infrastructure,
23 Aug 2024 3 min read
Ensuring Zero Downtime: A Guide to Pod Termination in Kubernetes

Ensuring Zero Downtime: A Guide to Pod Termination in Kubernetes

Introduction Just as Kubernetes smoothly handles pod creation, it also manages pod termination to achieve zero downtime. Consider an application running with 20 pods during peak times but scaling down to 2 pods during low traffic periods due to the minimum replica count being set to 2. While it might
21 Aug 2024 3 min read
AWS Instance Metadata Service v2 can cause outages. Make sure you are safe!

AWS Instance Metadata Service v2 can cause outages. Make sure you are safe!

Introduction Recently AWS switched to IMDSv2 as the default for EC2 instances (Amazon EC2 Instance Metadata Service IMDSv2 by default | Amazon Web Services) . This change, which was meant to improve security, ended up causing quite a bit of trouble for a lot of AWS Clients who had been using old
16 Aug 2024 4 min read
Apache Airflow Use Cases for DevOps Engineers

Apache Airflow Use Cases for DevOps Engineers

Introduction Apache Airflow is a powerful orchestration tool primarily used by data engineers. However, its capabilities can significantly benefit DevOps engineers as well. By using Airflow, DevOps engineers can automate complex workflows and automate various infrastructure use cases. Airflow as a platform is useful for developing, scheduling and monitoring batch-oriented
14 Aug 2024 4 min read
Configure Azure AD OAuth2 authentication for Grafana using Helmfile

Configure Azure AD OAuth2 authentication for Grafana using Helmfile

Introduction Azure AD OAuth2 authentication allows Grafana to use Azure Active Directory (Azure AD) as an identity provider. This means users can log in to Grafana using their Azure AD credentials. The authentication process involves several steps to ensure secure access. How it works: 1. User Requests Access: When a
07 Aug 2024 4 min read
How to setup an NGINX Ingress with cert-manager using Helmfile

How to setup an NGINX Ingress with cert-manager using Helmfile

In this blog, we will explain how to set up your NGINX Ingress with a TLS/SSL certificate using Helmfile. The traditional methods, involve multiple steps and manual configurations, can be time-consuming and error-prone. for this demo, we are using the domains grafana-ai.takemetoprod.com and Nginx as load balancers.
02 Aug 2024 3 min read
Explore all the new features in Kubernetes 1.30

Explore all the new features in Kubernetes 1.30

Kubernetes 1.30, nicknamed "Uwubernetes," marks the first release of 2024. This release brings 45 enhancements, including 10 new or improved Alpha features, 18 Beta features enabled by default, and 17 features graduating to Stable. The name "Uwubernetes" combines Kubernetes with "Uwu," an emoticon
29 Jul 2024 5 min read
How You can Automate PostgreSQL Backups to S3 Using Apache Airflow!

How You can Automate PostgreSQL Backups to S3 Using Apache Airflow!

Introduction Managing database backups manually can be time-consuming and prone to errors. As a DevOps Engineer you're often tasked with managing multiple databases.Organizations need a reliable and automated method to regularly back up their databases securely. Apache Airflow offers a solution to this problem by providing a
23 Jul 2024 5 min read
Resize Images at Scale without breaking a sweat!

Resize Images at Scale without breaking a sweat!

Introduction Handling images at scale can be challenging — especially when you need to serve them in different resolutions and formats. Traditional methods often involve batch processing to asynchronously process and store the images, which is time-consuming and inefficient. But there’s a better way, which saves a lot of time
23 Jul 2024 3 min read
Simplify Your Deployments with Keel.sh: Why GitOps Might Not Be the Best Fit

Simplify Your Deployments with Keel.sh: Why GitOps Might Not Be the Best Fit

Introduction While GitOps has gained popularity for managing infrastructure and applications, Keel.sh offers a simpler and more streamlined alternative for your deployment processes. This article explores the benefits of Keel.sh and why GitOps might not always be the best fit for your needs. Understanding Keel.sh What is
23 Jul 2024 3 min read
Why Use Amazon RDS Instead of a Database on EC2?

Why Use Amazon RDS Instead of a Database on EC2?

You’ve decided to move your applications from on-premises to AWS and are looking at the cloud services that best meet your needs. When moving an application with a relational database like Oracle, MySQL, or SQL Server to the cloud, you'll face the choice between Amazon RDS and
23 Jul 2024 5 min read
Point-In-Time Recovery (PITR) in Modern Relational Databases

Point-In-Time Recovery (PITR) in Modern Relational Databases

Introduction Have you ever accidentally deleted important data from your database? Or made changes that you wish you could undo? Point-In-Time Recovery (PITR) can save the day! This feature in the modern-day DBMS system lets you restore your database to any point in time within a certain period. Let'
23 Jul 2024 2 min read
Global VPC - how is it different from AWS

Global VPC - how is it different from AWS

Introduction Virtual networking stack offered by GCP is fundamentally different from AWS. While AWS got stuck with their initial design, GCP got time to learn from their mistakes and build a well thought VPC system that supports interconnectivity across regions by default. In this blog we're going to
23 Jul 2024 2 min read
Pod Disruption Budgets: Why They Matter and How to Use Them to Avoid Downtime

Pod Disruption Budgets: Why They Matter and How to Use Them to Avoid Downtime

Kubernetes pods are the smallest units you can deploy on the Kubernetes platform. Each pod represents a single running process and operates from a node or worker machine within Kubernetes, which can be either virtual or physical. Sometimes, Kubernetes pods might get disrupted, either voluntarily or involuntarily. This is more
23 Jul 2024 3 min read
Pydantic: Fast and Pythonic Data Validation for Your Python Applications

Pydantic: Fast and Pythonic Data Validation for Your Python Applications

In any application, ensuring that the data you’re working with is valid and well-formed is a critical part of ensuring that the application runs smoothly and reliably. In Python, there are many libraries available for data validation, but one that stands out for its ease of use, performance, and
23 Jul 2024 4 min read
A Deep Dive into Iptables: From Zero to Hero in One Blog Series

A Deep Dive into Iptables: From Zero to Hero in One Blog Series

What is iptables? Iptables is a command-line utility for configuring the firewall rules of the kernel’s netfilter framework. It allows system administrators to filter and manipulate incoming, outgoing, and forwarded network packets based on various criteria such as IP addresses, ports, protocols, and packet states. Iptables explained to a
23 Jul 2024 4 min read
Simplifying Garbage Collection: Python’s Winning Strategy Against Java

Simplifying Garbage Collection: Python’s Winning Strategy Against Java

Introduction The way Python handles garbage collection is miles apart from how Java does it. The approach taken by each of these languages impacts the performance and ease of use in multiple ways. In the world of programming, memory management is a critical aspect that can significantly impact the performance
23 Jul 2024 3 min read
An Opinionated Guide for Writing Awesome Python Scripts!

An Opinionated Guide for Writing Awesome Python Scripts!

Introduction In the world of Python development, the proper setup can significantly boost productivity and ensure that you can write robust scripts. A collection of libraries knit together can make a huge difference in the quality of programs that you write. From command-line argument parsing to HTTP request handling — This
23 Jul 2024 3 min read
Defensive Programming in Python: Part 2: Input Validation

Defensive Programming in Python: Part 2: Input Validation

Introduction Python is not a strongly typed language — which means things can go wrong at runtime. Python provides you with a dynamic environment, where variables don’t need a declared type before use, flexibility comes hand-in-hand with the challenge of unexpected runtime errors. These errors often stem from data not
23 Jul 2024 5 min read
Defensive Programming in Python: Part 1: Golden Rules for Logging

Defensive Programming in Python: Part 1: Golden Rules for Logging

Introduction Welcome to the first post in the series of Defensive Programming. In this series, I am going to cover how to write code in Python that helps you sleep well at night. Code that you can rely on to work in production and not fail you unexpectedly. Python is
23 Jul 2024 4 min read
Bypassing the Walls: A Guide to Accessing Private Databases in AWS VPC!

Bypassing the Walls: A Guide to Accessing Private Databases in AWS VPC!

Introduction One common challenge that developers face while working with AWS (Amazon Web Services) involves connecting to a private database that isn’t publicly accessible. This database is hosted inside a Virtual Private Cloud (VPC) and can only be accessed within the VPC. To overcome this problem, we can utilize
10 Jul 2024 3 min read
The easiest way to deploy a React Application on AWS with Terraform

The easiest way to deploy a React Application on AWS with Terraform

Introduction A React application is just a collection of js, css and html files when built. In this blog I am going to share how you can deploy a simple React application on AWS, leveraging the power of Terraform for automation. This guide is perfect for those who want to
10 Jul 2024 2 min read
The Ultimate Swiss Army Knife for Handling Files and Directories in Python!

The Ultimate Swiss Army Knife for Handling Files and Directories in Python!

Python’s pathlib library is a module that provides an object-oriented approach to working with file paths and directories in a platform-independent manner. It was introduced in Python 3.4 and offers a more intuitive way of working with files and directories than the traditional os.path module. Pathlib allows
10 Jul 2024 2 min read
An easier way to auto-remediate memory leaks on Kubernetes!

An easier way to auto-remediate memory leaks on Kubernetes!

Introduction In the world of Kubernetes, being able to keep a constant check on the resource utilization of pods, and taking action when a certain threshold is breached, is important. With such power, you can automatically prevent outages, improve application performance, and increase system reliability. In this blog, we will
09 Jul 2024 5 min read
Why You Should Consider Loki as an Alternative to Elasticsearch!

Why You Should Consider Loki as an Alternative to Elasticsearch!

Log monitoring is vital for any modern infrastructure. Mention log monitoring and the first thing that might pop into many minds is Elasticsearch. It’s an incredibly popular and powerful tool that has dominated the market for a good reason. However, Elasticsearch might not always be the ideal solution, especially
09 Jul 2024 3 min read
The Pitfalls of Docker Logging: Common Mistakes and Best Practices

The Pitfalls of Docker Logging: Common Mistakes and Best Practices

Introduction Containers have revolutionized how we build, ship, and run applications, but it also brings its own set of challenges, especially when it comes to logging. There are some common mistakes that a lot of people do when it comes to handling logs. Let’s explore them and some best
09 Jul 2024 3 min read
Most Developers Dont Know about AWS Nitro System: Find Out Why

Most Developers Dont Know about AWS Nitro System: Find Out Why

As Cloud-DevOps engineers, we’re always on the lookout for technologies that boost performance, enhance security, and improve availability. The AWS Nitro System is one such innovation, yet surprisingly most Engineers I interact with remain unaware of its capabilities. AWS Introduced Nitro in 2017 and since then they have introduced
09 Jul 2024 2 min read
Why CRI Matters: Enhancing Kubernetes with Standardized Runtimes!

Why CRI Matters: Enhancing Kubernetes with Standardized Runtimes!

Introduction The Container Runtime Interface (CRI) is a fundamental part of Kubernetes, yet many Cloud-DevOps engineers find it challenging to understand. This blog aims to clarify the concept of CRI, explain its importance, and showcase the power of the layered approach it enables. Why CRI is Important CRI is crucial
09 Jul 2024 2 min read
Get Your Python Configurations Right Every Time with Pydantic Settings

Get Your Python Configurations Right Every Time with Pydantic Settings

Introduction When you’re developing a serious Python application, you’ll often need configuration parameters that can change based on where the application is running. Environment variables are a great way to handle this because they allow you to adjust settings without changing your application code. Just tweak the environment
02 Jul 2024 3 min read
Page 1 of 4 Older Posts →
KubeBlogs - DevOps and Cloud content © 2025
  • DevOps
  • Cloud
  • Python
By KubeNine Powered by Ghost