Geek Logbook

Tech sea log book

Recent Posts

Categories

#50projectsIn50days #DjangoDevToDeployment Airflow Amazon S3 Amazon Web Services AWS bash bastion host Batch code Coders At Work Computer Science Data Databases Databricks Data Intensive Applications data lakes Dijkstra Edsger W. Dijkstra faker Google Colab Hellerstein Jinja Knowledge Transfer Leadership Models of Computer Programming Networking Networks Protocols Python Redash Seweetviz Social Skills SODA Software Developer Spark: The Definitive Guide SQL SSH Testing The humble programmer Traversy Media Ubuntu Understanding Distributed Systems Virtual Box Web Development whale-alert

Archives

Month: December 2022

Set secrets in Databricks

If you add as plain text the user and password of your connections you are making a mistake that it’s easy to solve. In order to solve Now you can use the CLI and it should be connected to your instances. So, now we can run the commands to set the keys. For example, if
Read More

Difference between Framework and Libraries

Software Development has tricky words. Some Jargon that seems as unreachable when we are starting. Even though is not a game changer understand this difference is a nice to have and in one or two paragraph I’m going to point the ideas that give me some impression that what are the key points in the
Read More

Resource from Vanguard ETF

Looking for vanguard ETF data is not an easy task. Because there are a lot of pages that need to subscribe or even purchase a subscription. So, we can’t access to free information. I don’t know if this behavior is normal across the industry, or I am thinking wrong about that. Because the composition of
Read More

Load data from Snowflake to S3

If you want to load data from Snowflake to S3 should try to use the COPY INTO command so, you run something like this command in the snowflake Web App: copy into @my_ext_unload_stage/d1 from mytable; And receive the following error: Failure using stage area. Cause: [Access Denied (Status Code: 403; Error Code: AccessDenied)] To solve
Read More

Using Presing in AWS

Presing is a command you can use in the AWS CLI that allows anyone to have the pre-signed URL to make and HTTP get request to retrieve the data that is inside the bucket pre-signed. In the CLI you will execute: aws s3 presign s3://DOC-EXAMPLE-BUCKET/test2.txt And the output you’re going to receive is the following:
Read More

Load CSV file from S3 to NEO4J

If you try to load data from S3 to NEO4J you are going to need to presing the file. So you need to expose the data to somebody that have the file. So, first you need to presing the file: aws s3 presign s3://rohank/actors.csv And then you can load the data on your NEO4J Instance:
Read More