Geek Logbook

Tech sea log book

Recent Posts

Categories

#50projectsIn50days Airflow Amazon Web Services Apache Iceberg AWS Azure bash bastion host Batch CAP Coders At Work Data data lakes Data Warehouse Docker Edsger W. Dijkstra Excel Git Hadoop HDFS Hellerstein Hive Javascript Networking NoSql Power Bi Powershell Python Redash S3 Social Skills Software Developer Spark Spark: The Definitive Guide SQL SSH terraform Testing The Elements of Programming Style Traversy Media Ubuntu Understanding Distributed Systems Virtual Box whale-alert Yaml

Archives

Month: June 2025

The Origin and Evolution of the DataFrame

When working with data today—whether in Python, R, or distributed computing platforms like Spark—one of the most commonly used structures is the DataFrame. But where did it come from? This post explores the origin, evolution, and growing importance of the DataFrame in data science and analytics. What is a DataFrame? A DataFrame is a two-dimensional
Read More

Understanding ORM: Bridging the Gap Between Objects and Relational Databases

In modern software development, working with databases is a fundamental requirement. Most applications need to persist, retrieve, and manipulate data stored in relational databases such as PostgreSQL, MySQL, or SQLite. Traditionally, this interaction has been done through SQL queries. However, Object-Relational Mapping (ORM) has emerged as a powerful alternative that simplifies and streamlines this process.
Read More

Understanding findOne and findOneAndUpdate in Mongoose: Key Differences and Practical Usage

When working with MongoDB through Mongoose in Node.js, developers frequently encounter two essential methods: findOne and findOneAndUpdate. Both methods perform document lookups, but they serve distinct purposes and are used in different contexts. In this post, we will break down their core differences, typical use cases, and best practices to optimize your MongoDB queries. The
Read More

Are NoSQL Databases Really Schema-less?

A Perspective from the MERN Stack When we first start learning about NoSQL databases, one of the most common things we hear is that they are “schema-less.” At first glance, this seems like a huge advantage: total flexibility, the ability to adapt quickly, and storage that isn’t bound by strict rules. But when we dive
Read More

How Network Topology Shapes Distributed Computing and Big Data Systems

When discussing distributed systems and Big Data, people often focus on storage, processing frameworks, and scalability—but one foundational concept underlies it all: network topology. It’s the invisible architecture that dictates how data flows, how quickly systems respond, and how resilient your applications can be. Let’s explore what network topology is, how it evolved, and why
Read More

When Should You Use Parquet and When Should You Use Iceberg?

In modern data architectures, selecting the right storage and management solution is essential for building efficient, reliable, and scalable pipelines. Two popular choices that often come up are Parquet and Apache Iceberg. While they can work together, they serve different purposes and solve different problems. This article explains what each one is, when to use
Read More

How to Fix ‘DataFrame’ object has no attribute ‘writeTo’ When Working with Apache Iceberg in PySpark

If you’re working with Apache Iceberg in PySpark and encounter this error: You’re not alone. This is a common mistake when transitioning from the traditional DataFrame.write syntax to Iceberg’s DataFrameWriterV2 API. Let’s walk through why this happens, how to fix it quickly, and when to use each writing method. Why This Error Happens The method
Read More