Zach Wilson LinkedIn Posts

In light of the current job market challenges, I want to extend a helping hand to my mentees who are recent graduates or

This is no "best" technology. Tech selection has so many dimensions to it that picking Microsoft Access and Excel might be the best

When I got an offer from Facebook back in 2016, my company at the time Research Innovations Incorporated countered with more money.

And

Video games were hugely beneficial for my career.

Here’s why:

1. They taught me to be competitive. This included dealing with failure gracefully.

Creators that inspire me to do better:

- Daliana Liu
Her podcast The Data Scientist Show and her LinkedIn posts are great. Building community

I applied to a tech lead role at Airbnb that required 10+ years of experience. I only had 6 years of experience.

I

I once worked for a company as a mid-weight engineer, where in the yearly review, they promised they would review my salary in

Data engineering leaders need to care more about how their team is doing than what pipelines they are building!

Trusting your engineers to correctly

Data engineers who can do feature engineering will make way more money!

What do you need to know when picking good features?

- Categorical

Here are all the things that went wrong in the first week of v3:

- server crashed during the last 10 mins of

Slow JOINs are one of the most painful parts of data engineering!

Here are some tips to optimize them:

- filter your data ahead

Data engineering is much more than knowing Spark and Airflow!

Data engineers need to be communicative with the business. Can you produce data

My entrepreneurial tech stack as someone who’s technical:

- Newsletter: Substack

- Link site: TechCreator (the platform I’m building), my example site: https://lnkd.in/gdK2kEzu

-

I had this crazy ETL job in my career that used to do things over REST calls and I moved it to be

Shuffling can be a serious bottleneck in your distributed SQL queries!

These keywords cause shuffle:
- GROUP BY
Since the source data might

OLTP and OLAP data modeling and querying are fundamentally different!

OLTP:
- focused on latest state of data
- normalization and 3rd normal form

Data modeling has two “flavors” that compete aggressively depending on your use case!

The first flavor prefers compactness, minimizing duplication and normalization. This

Fundamental concepts every data engineer should know because they don’t really change

- ANSI SQL
- distributed compute
- OLTP vs OLAP
- CAP

I didn’t follow any “roadmaps” when building my career!

I found things I wanted to build and learned the things I needed to build

In life, you meet a few rare people who change your course dramatically.

These people offer a new path to you that’s exciting