Geek Logbook

Tech sea log book

Recent Posts

Categories

#50projectsIn50days Airflow Amazon Web Services AWS Azure Batch CAP Coders At Work cron Data Databases Data Warehouse Django Edsger W. Dijkstra Excel Git Google Hadoop Hellerstein Hive Javascript Knowledge Transfer MVC Network Address Translation Networking Notes on Structured programming PHP Power Bi Powershell Public Subnet Python Redash Social Skills Software Developer Spark Spark: The Definitive Guide SQL SSH SurrogateKeys Testing The Elements of Programming Style Traversy Media Understanding Distributed Systems whale-alert Yaml

Archives

Category: Notes

Notes taking about the different books I’ve read since the blog started. Usually related to specific technology but, sometimes I read about tech history.

OLTP vs. OLAP: How JOINs and Efficiency Shape Their Differences

Online Transaction Processing (OLTP) and Online Analytical Processing (OLAP) are two distinct database architectures, each designed for different purposes. One key factor that differentiates them is how they handle JOIN operations and the impact these have on query performance. In this post, we’ll explore these differences and why OLAP tends to be more efficient for
Read More

The Origins of OLTP and OLAP: A Brief History

Online Transaction Processing (OLTP) and Online Analytical Processing (OLAP) are fundamental concepts in database management, each serving distinct purposes. But when did these terms first appear, and how did they evolve? Let’s explore their origins and how they became the cornerstone of modern data systems. The Emergence of OLTP The concept of Online Transaction Processing
Read More

Enabling Internet Access for Resources in a Public Subnet

When deploying resources in a public subnet within an AWS Virtual Private Cloud (VPC), you need to configure several components to allow them to communicate with the internet. Below are the essential steps: 1. Attach an Internet Gateway (IGW) An Internet Gateway (IGW) enables communication between instances in your VPC and the internet. To set
Read More

Network Address Translation (NAT): Overcoming IPv4 Shortages

Introduction Network Address Translation (NAT) is a technology designed to mitigate the shortage of IPv4 addresses by allowing multiple devices on a private network to share a limited number of public IP addresses. This process involves translating private IPv4 addresses to public addresses, enabling seamless communication with external networks. Types of NAT There are three
Read More

Why OLTP Systems Don’t Retain Historical Changes

Online Transaction Processing (OLTP) systems are designed for high-speed transactions and efficient data management. However, one of their characteristics is that they do not retain historical changes by default. In this post, we will explore why this happens and provide an example to illustrate the concept. OLTP Systems: Focused on Current Data OLTP databases are
Read More

Understanding the Relationship Between Database Replication and the CAP Theorem

Introduction Database replication is a fundamental strategy in distributed systems that ensures data is duplicated across multiple nodes. However, when designing a replicated database, one must consider the CAP theorem, which defines the fundamental trade-offs in distributed computing. In this post, we will explore how the CAP theorem applies to database replication and what trade-offs
Read More

Understanding the Differences Between Parquet, Avro, JSON, and CSV

When working with data, choosing the right file format can significantly impact performance, storage efficiency, and ease of use. In this post, we will compare four widely used data formats: Parquet, Avro, JSON, and CSV. Each has its strengths and weaknesses, making them suitable for different scenarios. 1. Parquet Overview: Parquet is a columnar storage
Read More

Understanding the CAP Theorem in NoSQL Databases

The CAP theorem (Consistency, Availability, and Partition Tolerance) plays a crucial role in designing and selecting NoSQL databases. This theorem states that in a distributed system, it is impossible to achieve all three properties simultaneously: How CAP Theorem Relates to NoSQL Databases NoSQL databases are designed for scalability and flexibility, often trading off one CAP
Read More

Understanding Docker Engine Components

Docker Engine is an open-source platform that has revolutionized how applications are developed, deployed, and executed using container technology. By encapsulating applications and their dependencies in lightweight, portable containers, Docker ensures consistent behavior across different environments. Understanding the fundamental components of Docker is crucial to fully leveraging its capabilities. Core Components of Docker Engine 1.
Read More

What Does an Exploratory Data Analysis (EDA) Evaluate?

An Exploratory Data Analysis (EDA) is a critical step in the data analysis process that focuses on evaluating and examining data to uncover its main characteristics. It is performed before delving deeper into analysis or building predictive models. The primary purpose of an EDA is to understand the dataset, identify issues, and gain insights that
Read More