This course is part of the Python, Bash and SQL Essentials for Data Engineering Specialization

Noah Gift +2 more instructors

Offered By

Python, Bash and SQL Essentials for Data Engineering SpecializationDuke University

About this Course

21,803 recent views

In this second course of the Python, Bash and SQL Essentials for Data Engineering Specialization, you will learn the fundamentals of Linux necessary to perform data engineering tasks. Additionally, you will explore how to use both Bash and zsh configurations, and develop the syntax needed to interact and control Linux. These skills will allow you to manage and manipulate databases in a Bash environment.

Flexible deadlines

Reset deadlines in accordance to your schedule.

Shareable Certificate

Earn a Certificate upon completion

100% online

Start instantly and learn at your own schedule.

Course 2 of 4 in the

Python, Bash and SQL Essentials for Data Engineering Specialization

Intermediate Level

Some prior experience working with Linux (< 1 year)

Approx. 22 hours to complete

English

Subtitles: English

What you will learn

Use Linux tools build data engineering solutions.
Develop Bash syntax to configure and control Linux.

Skills you will gain

Bash (Unix Shell)
Database (DBMS)
Data Management
Linux

Flexible deadlines

Reset deadlines in accordance to your schedule.

Shareable Certificate

Earn a Certificate upon completion

100% online

Start instantly and learn at your own schedule.

Course 2 of 4 in the

Python, Bash and SQL Essentials for Data Engineering Specialization

Intermediate Level

Some prior experience working with Linux (< 1 year)

Approx. 22 hours to complete

English

Subtitles: English

Instructors

Offered by

Duke University

Duke University has about 13,000 undergraduate and graduate students and a world-class faculty helping to expand the frontiers of knowledge. The university has a strong commitment to applying knowledge in service to society, both near its North Carolina campus and around the world.

Syllabus - What you will learn from this course

Week

Week 1

7 hours to complete

Using Linux

This week you will learn to use Linux to solve technical problems common in software engineering, data engineering and machine learning. You will explore the key parts of the Linux shell, and learn how to implement your knowledge in common scenarios.

7 hours to complete

18 videos (Total 99 min), 2 readings, 1 quiz

18 videos

Welcome to Linux and Bash for Data Engineering57s

Meet your Course Instructor: Noah Gift48s

Overview of Key Concepts4m

Introduction to Working with Linux41s

Introduction to the Linux Shell2m

Installing and Accessing Linux11m

Getting Started with Github Codespaces9m

Comparing Linux Shell Environments9m

Writing 'Hello World' Bash Script6m

Popular Terminal Commands in Linux14m

Introduction to Shell Piping1m

What is Shell Piping?3m

Walkthrough of Shell Pipeline Examples12m

Introduction to SSH1m

What is SSH?4m

Creating SSH Keys and using with GitHub4m

Using SSH to Connect to Remote Server in AWS Cloud7m

Walkthrough of SSH Tunneling Example4m

2 readings

Meet your Supporting Instructors: Kennedy Behrman and Alfredo Deza10m

Course Structure and Discussion Etiquette10m

1 practice exercise

Using Linux30m

Week

Week 2

5 hours to complete

Using Bash

This week, you will learn to configure Bash Scripts to enhance and control your Linux development environment and production systems. You will also learn about Shell variables, and how to effectively use Standard In and Standard Out.

5 hours to complete

14 videos (Total 65 min)

14 videos

Introduction to Working with Bash45s

Introduction to Configuring your Bash Shell Environment2m

What are Shell Configuration Files?5m

Configuring .bashrc11m

Configuring .zshrc and Third-Party Tool oh-my-zsh9m

Introduction to Working with Shell Variables1m

What are Shell Variables?4m

Exporting Shell Variables in an Interactive Prompt6m

Using Shell Variables in a Bash Script7m

Introduction to Standard Streams1m

What are Standard Streams?2m

Using Standard Out5m

Using Standard In2m

Using Standard Error2m

1 practice exercise

Using Bash30m

Week

Week 3

6 hours to complete

Building Bash Scripts

This week, you will learn to build Bash Scripts to solve common problems in Data Engineering. You will also learn about Shell logic, dealing with data in the shell, and how to build command-line tools in Bash. You will then apply this knowledge to create command-line tools in Bash.

6 hours to complete

18 videos (Total 63 min)

18 videos

Introduction to Building Bash Scripts44s

Introduction to Shell Logic and Control Flow52s

What is Shell Control Flow?2m

Using Shell Control Flow to Solve Problems in Bash2m

Using Shell Loops in Bash6m

Evaluating Conditions in Bash5m

Introduction to Manipulating Data in the Bash Shell1m

Shell Techniques for Data in the Bash Shell2m

Truncating Data in Bash3m

Filtering Data in Bash3m

Searching Data in Bash4m

Introduction to Writing Scripts and Command-Line Tools in Bash31s

What are Scripts and Command-Line Tools?3m

Building a Bash Script4m

Building a Bash Function5m

Building a Bash Command-Line Tool3m

Bash-Adjacent Tools: Makefiles and Dockerfiles7m

Data Structures in Bash4m

1 practice exercise

Building Bash Scripts30m

Week

Week 4

6 hours to complete

Composing File and Data Solutions

This week, you will learn to use Linux to compose file and data management solutions. You will also learn to search the filesystem, modify files, directories and control permissions. You will then process text in Bash and apply this knowledge to create a search solution in Bash.

6 hours to complete

17 videos (Total 62 min)

17 videos

Introduction to Composing File and Data Management Solutions in Linux29s

Introduction to Searching a Filesystem in Linux45s

Methods for Searching a Filesystem in Linux4m

Using the Locate Command to Find Files in Linux3m

Using the Find Command to Find Files in Linux2m

Using xargs to Extend Search Capabilities in Linux2m

Using mdfind on OS X6m

Introduction to Modifying Files, Directories, Permissions and Archiving in Linux40s

Overview of Modifying the Filesystem in Linux3m

Moving Files and Directories in Linux6m

Setting Permissions on Files and Directories in Linux4m

Archiving Data in Linux3m

Introduction to Processing Text in Linux40s

Benefits of Processing Text in Linux1m

Using grep, cut, sort and unique in Linux8m

Editing with Truncation, awk and sed in Linux7m

Using Regular Expressions (regex) in Linux5m

1 practice exercise

Composing File and Data Management Solutions with Linux30m

About the Python, Bash and SQL Essentials for Data Engineering Specialization

If you are interested in developing the skills needed to be a data engineer, the Python, Bash and SQL Essentials for Data Engineering Specialization is a great place to start. We live in a world that is driven by big data - from what we search online to the route we take to our favorite restaurant, and everything in between. Businesses and organizations use this data to make decisions that impact the ways in which we navigate our lives. How do engineers collect this data? How can this data be organized so that it can be appropriately analyzed? A data engineer is specialized in this initial step of accessing, cleaning and managing big data.

Data engineers today need a solid foundation in a few essential areas: Python, Bash and SQL. In Python, Bash and SQL Essentials for Data Engineering, we provide a nuts and bolts overview of these fundamental skills needed for entering the world of data engineering. Led by three professional data engineers, this Specialization will provide quick and accessible ways to learn data engineering strategies, give you a chance to practice what you’ve learned in integrated lab exercises, and then immediately apply these techniques in your professional or academic life.

Frequently Asked Questions

When will I have access to the lectures and assignments?
Access to lectures and assignments depends on your type of enrollment. If you take a course in audit mode, you will be able to see most course materials for free. To access graded assignments and to earn a Certificate, you will need to purchase the Certificate experience, during or after your audit. If you don't see the audit option:
The course may not offer an audit option. You can try a Free Trial instead, or apply for Financial Aid.
The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
What will I get if I subscribe to this Specialization?
When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile. If you only want to read and view the course content, you can audit the course for free.
Is financial aid available?
Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.

More questions? Visit the Learner Help Center.

Linux and Bash for Data Engineering

About this Course

What you will learn

Skills you will gain

Instructors

Noah Gift

Kennedy Behrman

Alfredo Deza

Offered by

Duke University

Syllabus - What you will learn from this course

Week 1

Using Linux

Week 2

Using Bash

Week 3

Building Bash Scripts

Week 4

Composing File and Data Solutions

About the Python, Bash and SQL Essentials for Data Engineering Specialization

Frequently Asked Questions

Start or advance your career

Browse popular topics

Popular courses and articles

Earn a degree or certificate online

Coursera

Community

More

Linux and Bash for Data Engineering

About this Course

What you will learn

Skills you will gain

Instructors

Noah Gift

Kennedy Behrman

Alfredo Deza

Offered by

Duke University

Syllabus - What you will learn from this course

Week 1

Using Linux

Week 2

Using Bash

Week 3

Building Bash Scripts

Week 4

Composing File and Data Solutions

About the Python, Bash and SQL Essentials for Data Engineering Specialization

Frequently Asked Questions

Coursera Footer

Start or advance your career

Browse popular topics

Popular courses and articles

Earn a degree or certificate online

Coursera

Community

More