YouTube Data Analysis | END TO END DATA ENGINEERING PROJECT

➡️ Check Out My Data Engineering Bootcamp: https://bit.ly/3yXsrcy
USE CODE: COMBO50 for a 50% discount

In this video, you will execute the END TO END DATA ENGINEERING PROJECT using Kaggle YouTube Trending Dataset.

If you are someone who wants to learn Data Engineering by doing hands-on projects then this video is for you!

👉🏻Part 2 of the video - https://www.youtube.com/watch?v=qFaaKme5eDE

✨Visit ProjectPro for more projects - https://bit.ly/3iIGfM5

Useful links mentioned in the video -
1. Create Your AWS Account - https://aws.amazon.com/premium....support/knowledge-ce
2. Download AWS CLI - https://aws.amazon.com/cli/
3. Download Data From Here - https://www.kaggle.com/datasnaek/youtube-new

Find Commands and Code Used in the video here - https://github.com/darshilparm....ar/dataengineering-y

👉🏻 Learn Basics (If you don't know) 👈🏻
1. Learn Python From Here - https://bit.ly/3t9pFLx
2. Learn SQL here - https://bit.ly/3KNmUW8
3. Learn Spark and Big Data - https://bit.ly/3telBcW
4. Learn AWS Lambda - https://aws.amazon.com/lambda/

Join Data With Darshil Discord Server: https://discord.gg/dHjvD8JCG3

Timestamps
0:00 Project Introduction (Very Important)
2:22 What You Will Learn
4:57 Understand Dataset That We Are Going To Use
6:16 On-Premise vs Cloud Data Processing
8:50 Create Your AWS Account
9:19 Best Practices To Follow On AWS
9:59 Create IAM Account For Admin
13:15 Install AWS CLI
16:05 Create S3 Bucket and Upload Our Data
22:05 What is Data Lake?
23:40 Understand Data That Got Uploaded
24:45 Build Glue Crawler and Catalog
30:14 Use Athena and SQL to Query Data
32:20 Solving Error and Preprocessing Data
34:57 Writing ETL Job In Lambda and Cleaning Data
42:33 What is AWS Lambda and Layers?
47:51 Querying Our Cleaned Data on Athena

👦🏻 My Linkedin - https://www.linkedin.com/in/darshil-parmar/
📷 Instagram - https://www.instagram.com/darshilparmarr
🎯Twitter - https://twitter.com/parmardarshil07

🌟 Please leave a LIKE ❤️ and SUBSCRIBE for more AMAZING content! 🌟

3 Books You Should Read
📈Principles: Life and Work: https://amzn.to/3HQJDyP
👀Deep Work: https://amzn.to/3IParkk
💼Rework: https://amzn.to/3HW981O

Tech I use every day
💻MacBook Pro M1: https://amzn.to/3CiFVwC
📺LG 22 Inch Monitor: https://amzn.to/3zk0Dts
🎥Sony ZV1: https://amzn.to/3hRpSMJ
🎙Maono AU-A04: https://amzn.to/3Bnu53n
⽴Tripod Stand: https://amzn.to/3tA7hu7
🔅Osaka Ring Light and Stand: https://amzn.to/3MtLAEG
🎧Sony WH-1000XM4 Headphone: https://amzn.to/3sM4sXS
🖱Zebronics Zeb-War Keyboard and Mouse: https://amzn.to/3zeF1yq
💺CELLBELL C104 Office Chair: https://amzn.to/3IRpiL2


👉Data Engineering Complete Roadmap: https://www.youtube.com/playli....st?list=PLBJe2dFI4sg
👉Data Engineering Project Series: https://www.youtube.com/playli....st?list=PLBJe2dFI4sg
👉Become Full-Time Freelancer: https://www.youtube.com/playli....st?list=PLBJe2dFI4sg
👉Data With Darshil Podcast: https://www.youtube.com/playli....st?list=PLBJe2dFI4sg



✨ Tags ✨
data engineering projects, big data project, data engineering project hands-on, hands-on data engineering projects, learn data engineering, data engineering roadmap, how to become data engineer, data engineering free projects, big data engineering, big data

✨ Hashtags ✨
#dataengineer #project #darshil