This course is part of the Python, Bash and SQL Essentials for Data Engineering Specialization

4.6

stars

27 ratings

Alfredo Deza +2 more instructors

2,212 already enrolled

Offered By

Python, Bash and SQL Essentials for Data Engineering SpecializationDuke University

About this Course

25,706 recent views

In this third course of the Python, Bash and SQL Essentials for Data Engineering Specialization, you will explore techniques to work effectively with Python and SQL. We will go through useful data structures in Python scripting and connect to databases like MySQL. Additionally, you will learn how to use a modern text editor to connect and run SQL queries against a real database, performing operations to load and extract data. Finally, you will use extracted data from websites using scraping techniques. These skills will allow you to work effectively when data is not readily available, or when spatial queries are required to extract useful information from databases.

Flexible deadlines

Reset deadlines in accordance to your schedule.

Shareable Certificate

Earn a Certificate upon completion

100% online

Start instantly and learn at your own schedule.

Course 3 of 4 in the

Python, Bash and SQL Essentials for Data Engineering Specialization

Intermediate Level

Some experience with Python programming (<1 year)

Approx. 19 hours to complete

English

Subtitles: English

What you will learn

Extract data from different sources and map it to Python data structures.
Design Scripts to connect and query a SQL database from within Python.
Apply scraping techniques to read and extract data from a website.

Skills you will gain

Database (DBMS)
Python Programming
Web Scraping
MySQL
SQL

Flexible deadlines

Reset deadlines in accordance to your schedule.

Shareable Certificate

Earn a Certificate upon completion

100% online

Start instantly and learn at your own schedule.

Course 3 of 4 in the

Python, Bash and SQL Essentials for Data Engineering Specialization

Intermediate Level

Some experience with Python programming (<1 year)

Approx. 19 hours to complete

English

Subtitles: English

Instructors

Offered by

Duke University

Duke University has about 13,000 undergraduate and graduate students and a world-class faculty helping to expand the frontiers of knowledge. The university has a strong commitment to applying knowledge in service to society, both near its North Carolina campus and around the world.

Syllabus - What you will learn from this course

Week

Week 1

5 hours to complete

Working with Data in Python

This week, you will learn how to effectively use Python’s data structures to load, persist, and iterate over data. You will apply these data structures to solve different problems when working with popular data formats like JSON.

5 hours to complete

19 videos (Total 62 min), 4 readings, 2 quizzes

19 videos

Welcome to Scripting with Python and SQL for Data Engineering45s

Meet your Course Instructor: Alfredo Deza29s

Overview of Key Concepts4m

Introduction to Working with Data in Python29s

Introduction to Python Data Structures46s

Using Lists to Save and Retrieve Data in Python5m

Using Dictionaries to Save and Retrieve Data in Python7m

Overview of Lesson Common Data Structures in Python4m

Recap of Data Structures in Python1m

Introduction to Choosing Data Structures in Python1m

Iterating Over Lists and Dictionaries in Python7m

Iterating Over Other Data Structures in Python2m

Storing Data Between Data Structures in Python6m

Recap of Mapping Data Structures in Python1m

Introduction to Data Sources and Formats in Python53s

Loading Data from Files and File Paths in Python6m

Working with JSON in Python6m

Saving Data from Python to Disk4m

Recap of Persisting and Loading Data in Python47s

4 readings

Meet your Supporting Instructors: Kennedy Behrman and Noah Gift10m

Course Structure and Discussion Etiquette10m

Python Lists and Dictionaries10m

Build a notebook that reformats data into JSON10m

2 practice exercises

Using Data Structures in Python30m

Working with Data in Python30m

Week

Week 2

5 hours to complete

Python Scripting and SQL

This week, you will learn how to use Python scripting techniques to work with SQL. You will create a database, store data, and query that data with SQL from Python.

5 hours to complete

15 videos (Total 56 min), 2 readings, 1 quiz

15 videos

Introduction to Python Scripting and SQL31s

Introduction to Scripting in Python40s

Creating a Script as a Module in Python5m

Traversing the File System with a Script in Python7m

Recap of Python Scripting Basics43s

Introduction to Embedded Databases48s

What is SQLite?2m

Creating and Connecting to a SQLite Database in Python5m

Saving and Querying from a SQLite Database in Python10m

Recap of SQLite and Python1m

Introduction to Querying with SQL in Python1m

Basic SQL Commands in Python6m

Extracting Distinct Data using SQL in Python7m

Searching with SQL in Python5m

Recap of Querying with SQL in Python1m

2 readings

Minimal Python, Chapter 2: Learn to Store Data10m

Create a Reporting Script for File Sizes10m

1 practice exercise

Python Scripting and SQL30m

Week

Week 3

5 hours to complete

Web Scraping using Python

This week, you will learn how to efficiently extract data from the web. You will learn how to use a scraping library to read data from websites and identify and extract specific values from it.

5 hours to complete

15 videos (Total 65 min), 3 readings, 1 quiz

15 videos

Introduction to Web Scraping using Python30s

Introduction to Extracting Data from Unstructured HTML1m

Challenges with Web Data3m

Parsing HTML with HTMLParser in Python5m

Recap of Web Scraping Techniques in Python40s

Introduction to Scrapy and XPath in Python1m

Creating a Web Scraping Project with Scrapy in Python6m

Parsing Data with XPath and Scrapy Shell11m

Using Scrapy Spider for Web Scraping5m

Recap of Scrapy and XPath in Python43s

Overview of Challenges with Web Scraping2m

Scraping Locally8m

Persisting Data in CSV and JSON Formats9m

Persisting Data to a SQLite Database6m

Recap of Persistence and Efficacy with Web Scraping1m

3 readings

Parsing Techniques with HTMLParser10m

Efficient Scraping Techniques10m

Build a Web Scraping Tool10m

1 practice exercise

Web Scraping using Python30m

Week

Week 4

4 hours to complete

Working with MySQL

This week, you will learn how to use a modern development environment and editor to connect to a MySQL database server, execute queries and perform database operations.

4 hours to complete

11 videos (Total 37 min), 2 readings, 1 quiz

11 videos

Introduction to Working with MySQL30s

Introduction to VSCode with MySQL1m

Connecting to a MySQL Server8m

Recap of VSCode with MySQL1m

Challenges of Running MySQL Queries1m

Using VSCode to Execute MySQL Queries6m

Recap of Running MySQL Queries1m

Challenges with Importing to Databases1m

Importing CSV Data into MySQL6m

Exporting Data from MySQL6m

Recap of Importing and Exporting Data in MySQL1m

2 readings

Working with VSCode and MySQL10m

Loading and Exporting Data using MySQL10m

1 practice exercise

Working with MySQL30m

About the Python, Bash and SQL Essentials for Data Engineering Specialization

If you are interested in developing the skills needed to be a data engineer, the Python, Bash and SQL Essentials for Data Engineering Specialization is a great place to start. We live in a world that is driven by big data - from what we search online to the route we take to our favorite restaurant, and everything in between. Businesses and organizations use this data to make decisions that impact the ways in which we navigate our lives. How do engineers collect this data? How can this data be organized so that it can be appropriately analyzed? A data engineer is specialized in this initial step of accessing, cleaning and managing big data.

Data engineers today need a solid foundation in a few essential areas: Python, Bash and SQL. In Python, Bash and SQL Essentials for Data Engineering, we provide a nuts and bolts overview of these fundamental skills needed for entering the world of data engineering. Led by three professional data engineers, this Specialization will provide quick and accessible ways to learn data engineering strategies, give you a chance to practice what you’ve learned in integrated lab exercises, and then immediately apply these techniques in your professional or academic life.

Frequently Asked Questions

When will I have access to the lectures and assignments?
Access to lectures and assignments depends on your type of enrollment. If you take a course in audit mode, you will be able to see most course materials for free. To access graded assignments and to earn a Certificate, you will need to purchase the Certificate experience, during or after your audit. If you don't see the audit option:
The course may not offer an audit option. You can try a Free Trial instead, or apply for Financial Aid.
The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
What will I get if I subscribe to this Specialization?
When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile. If you only want to read and view the course content, you can audit the course for free.
Is financial aid available?
Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.

More questions? Visit the Learner Help Center.

Scripting with Python and SQL for Data Engineering

About this Course

What you will learn

Skills you will gain

Instructors

Alfredo Deza

Kennedy Behrman

Noah Gift

Offered by

Duke University

Syllabus - What you will learn from this course

Week 1

Working with Data in Python

Week 2

Python Scripting and SQL

Week 3

Web Scraping using Python

Week 4

Working with MySQL

About the Python, Bash and SQL Essentials for Data Engineering Specialization

Frequently Asked Questions

Start or advance your career

Browse popular topics

Popular courses and articles

Earn a degree or certificate online

Coursera

Community

More

Scripting with Python and SQL for Data Engineering

About this Course

What you will learn

Skills you will gain

Instructors

Alfredo Deza

Kennedy Behrman

Noah Gift

Offered by

Duke University

Syllabus - What you will learn from this course

Week 1

Working with Data in Python

Week 2

Python Scripting and SQL

Week 3

Web Scraping using Python

Week 4

Working with MySQL

About the Python, Bash and SQL Essentials for Data Engineering Specialization

Frequently Asked Questions

Coursera Footer

Start or advance your career

Browse popular topics

Popular courses and articles

Earn a degree or certificate online

Coursera

Community

More