Online Course

[L4-DE] Best Practices for Data Engineering - Online

- - Online
[L4-DE] Best Practices for Data Engineering - Online

This course focuses on how to use KNIME Analytics Platform for data engineering and how to apply best practices when building data processing pipelines.

Learn the concepts behind connecting to multiple data sources, the methods for data anonymization, and advanced database topics. Be introduced to the Apache Hadoop ecosystem and find out how to handle big data with the Apache Spark integration. Finally, learn how to build and orchestrate modular workflows.

Put your knowledge into practice with hands-on exercises to build and orchestrate two applications: first, extract, validate, transform, blend, anonymize, and load the customer data to a database; second, use Spark to access, impute missing values, and aggregate the website usage data. 

This is an instructor-led course consisting of four, 75-minute online sessions run by one of our KNIME data scientists. Each session has an exercise for you to complete at home and together, we will go through the solution at the start of the following session. The course concludes with a 15 to 30 minute wrap up session.

Course Content

  • Session 1: Introduction & technical setup, ETL, Connectors & Data access
  • Session 2: ETL, Data anonymization, Databases
  • Session 3: ELT, Big Data, Hadoop, Spark
  • Session 4: Cloud and Big Data connectivity, Orchestration
  • Session 5: Q&A
Download agenda


What level of KNIME experience is needed for this course?

This course doesn’t provide a detailed introduction to KNIME Analytics Platform. You should be competent in using KNIME Analytics Platform. We expect that you have already built KNIME workflows and are aware of the workflow control concepts such as flow variables, loops, switches, and error handling. We recommend taking this course after obtaining the L1 and L2 KNIME proficiency or equivalent.

How do I join the course?

You’ll receive a zoom link with your registration confirmation. Make sure you have a stable internet connection!

What if I miss a session? Will I be able to watch a replay?

Sure! The sessions will be recorded and you’ll have access to each one for one month from the time the session is over.

Will I be able to ask questions?

Absolutely - fire away!

What do I need to have?

Your own laptop, pre-installed with the latest version of KNIME Analytics Platform. In order to complete the exercises, you would need to install a local instance of a PostgreSQL database. We will provide the details in the reminder email.

Where do I find the latest version of KNIME Analytics Platform?

Download the latest free, open source version of knime here:

What other resources are available to help me?