Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Beyond the theory, if you are having trouble getting your hands dirty, here is the path I had taken for data engineering:

(It is pretty hands on.)

After you are done with the initial learning, find an academic machine learning discord or something similar. There will always be people there who will be very happy to find someone to clean their data. It's a great way of getting hands on with data engineering.

System design is best learnt through fires.

A good angle of attack is: pick a certification like AWS SAA or equivalent(AWS, azure, Google cloud. Doesn't really matter. Just pick a mid level certification). Then do the labs. They will quickly point out the holes in your knowledge/understanding. The free tier will take care of your needs, and cloud providers most of the time forgive the first surprise bill(it happens to everyone).

Soon data engineering and systems design merge anyways. This path is like a cheat-code for forcing convergence. Otherwise, the mind will quickly forget most theory.

---

Adding to this:

When you get hands on, you will find how the mind lies to you about how much you know. Mind maps are a nice way to reliably detect holes in understanding. Sit down with paper & pen once a week or so, and make a big map of everything you know.



But why data engineering here?


Many modern systems are built around data. So, data engineering and systems engineering are very close.


It's mostly personal bias and circumstances.

Data engineering and systems design are incredibly close. After some time, they completely mesh together.

And from personal experience, the knowledge-volume to become practically potent is actually smaller from data engineering side (than from normal software development side).

I've found it easier to get data gigs and simultaneously strengthen the knowledge.

(I love databases, so that's also a factor)

The bonus $$$$ is also a nice side effect.


Really fantastic advice. Thank you very much!


You're welcome.

Also, keep in mind that the first month could be incredibly frustrating. (it was for me).

Once you understand the industry meta, until you learn the tools, it may turn into an exercise of frustration management.

But it is also a lot of fun.

All the very best.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: