Geek Logbook

Tech sea log book

Recent Posts

Categories

#50projectsIn50days Airflow Amazon Web Services Apache Iceberg AWS Azure bash Batch CAP Coders At Work Data data lakes Data Pipelines Data Warehouse Docker Edsger W. Dijkstra Excel Git Hadoop HDFS Hellerstein Hive Javascript Networking NoSql PostHog Postman Power Bi Powershell Pyspark Python Redash S3 Social Skills Software Developer Spark Spark: The Definitive Guide SQL SSH terraform Testing The Elements of Programming Style Understanding Distributed Systems whale-alert Yaml

Archives

Category: Others

SODA: Check count distinct elements

Categories in Data Quality When you are doing a quality you’re looking for six levels of knowledge about it. It might change depends on your requirements and what is the usage about it. Because, in general speaking the that not always work in a synchronous way, it’s possible that it could be from outside your
Read More

SODA: Connect to SQL Server

After deciding to install SODA to make your quality check you have to connect the data source to SODA. We are going to see how to connect soda to Microsoft SQL Server. Remember that this is a tutorial in order to use, in an easy way the SODA quality check tool on your machine .
Read More

ASTRONOMER: Install on Windows

Install Astronomer is quite simple In windows you have to follow the following steps: 1 – Install docker Go to the docker’s webpage, download the executable and install it. Installation succeeded 2 – Install Linux on Windows with WSL As you can see on the Microsoft documentation you have to run on PowerShell the following
Read More

What is an ‘Ephemeral cluster’?

When you create a service to compute, for example in HD-Insight you can create a cluster which remains active once it’s created or, in the other hand, stop (will be ‘deleted’) after some amount of innactivities. If you, like me, your first approach was with the Azure Service you’ll notice that the name if the
Read More

What is a bastion host?

Definition of Bastion Host A bastion host is a specific computer in a network that has the objective of not affecting another part of the system by the attack from outside the network. For Example, the internet. 

Are SSH and Bash the same? (Spoiler: No)

The thing is: when you start to run some console commands you notice that all the things you write in that place are not the same. Simple to understand, difficult to order each part in your head. I wondered at that time, What is the difference between SSH and Bash? This question was answered in
Read More

Connect Ubuntu in Virtual Box with SSH

After understanding the importance of a well understanding of ssh. It’s time to make our first practice connecting from our windows to a Ubuntu installed in a virtual machine in Virtual Box. You have to use the direction in the second red box. Useful Documentation:

SSH: A Brave new world

When you make your first steps as a developer, you realize that one of the first activities you have to do when your code is ready is to deploy it.  In that case, generally, the senior dev or someone of the dev-ops team says something like: After that, you ask yourself:  This irrelevant question for
Read More