Automation and Deployment - Remote Execution and KNIME WebPortal
In the previous chapter you learned how to establish a KNIME Server connection from KNIME Analytics Platform. In this chapter you’ll learn how you can execute workflows on KNIME Server for deployment and automation.
Imagine having a workflow, which creates a report that someone would like to see every morning when they come in to the office. Or, you have a workflow, which should be executed every x minutes, analyzing the data of the last x minutes. In these cases you want to execute the workflow remotely on KNIME Server - on a scheduled basis.
Video 1 of this chapter introduces you to workflow jobs and how you can execute workflows on KNIME Server, either immediately or via the different scheduling options. In addition, KNIME Server gives you the option to stay up to date on the progress of your workflow by sending notification emails based on failure or success.
The KNIME Remote Workflow Editor is another option to trigger the execution of a workflow on KNIME Server immediately. It allows you to execute workflows stepwise on KNIME Server, edit them, and investigate the output tables and views. Video 2 provides an overview of when the Remote Workflow Editor is useful and how you can use it to edit jobs on KNIME server in the same way as local workflows.
Video 3 introduces the KNIME WebPortal - a feature which allows data scientists to deploy their workflows as interactive, browser-based applications. It exposes users to just the right amount of complexity by allowing them to interact at predetermined interaction points from the web browser and, if needed, adjust certain parameters.
Another option to trigger the execution of a workflow on KNIME Server is via REST. Video 4 shows you how to seamlessly deploy workflows as industry standard web services from KNIME Analytics Platform via REST API, to build out your data science infrastructure.
Video: Remote Execution on KNIME Server
Video: KNIME Remote Workflow Editor
Video: KNIME WebPortal
Video: KNIME Server REST API
Test your Knowledge
1. How can you execute a workflow on KNIME Server immediately?
A. Select a workflow in the KNIME Explorer and use the execute button in the toolbar
B. Right click a workflow and select “Execute…” and click the “OK” button
C. Right click a workflow and select “Execute…”. Then go to the scheduling tab, activate the checkbox “Now”, and click the “OK” button
D. Right click a workflow and select “Execute now…”
2. What is a workflow job?
A. A copy of a workflow with specific settings and data
B. A previous version of a workflow
C. A shared text file
D. A job under development
3. You want to send a notification email to email@example.com and firstname.lastname@example.org for the long-running workflow “generate_test_report” if - and only if - the execution has been successful. What do you have to do?
A. Right click the workflow “generate_test_report” and select “Execute…” to open the execution dialog. Next, activate the checkbox “Notify upon completion”, click the plus button, add the two email addresses separated by a comma, and make sure that there is a green tick for “On Success” and red cross for “on Failure”.
B. Right click a running job of the workflow “generate_test_report” and select “Email notification”. Next, activate the checkbox “Notify upon completion”, click the plus button, add the two email addresses separated by a comma, and make sure that there is a green tick for “On Success” and red cross for “on Failure”.
C. Right click the workflow “generate_test_report” and select “Execute…” to open the execution dialog. Activate the checkbox “Notify upon completion”. Click twice on the plus sign to add two rows. Remember, only one email address per row is possible. Add the two email addresses and make sure that there are green ticks for “On Success” and red crosses for “on Failure”.
D. Right click the workflow “generate_test_report” and select “Notifications” to open the notification dialog. Click on the plus sign and add the two email addresses separated by a comma and make sure that there is a green tick for “On Success” and red cross for “on Failure”.
4. The execution of a workflow on KNIME Server failed. What can you do to find out what caused the problem? (2 answers are correct)
A. Copy the job to LOCAL and open it
B. Use the Remote Workflow Editor to open the job by double clicking a job
C. Save the job as a workflow and open the workflow
D. Contact a user with admin rights - they can use the Remote Workflow Editor to investigate why jobs fail
5. Which of the following statements is true? (2 answers are correct)
A. The KNIME WebPortal can be used to upload workflows to KNIME Server
B. Each metanode of a workflow creates one page on the KNIME WebPortal
C. The KNIME WebPortal is a place to share, comment, and rate workflows
D. Each component of a workflow creates one page on the KNIME WebPortal
E. The KNIME WebPortal allows step by step execution of workflows via a web browser
F. The KNIME WebPortal allows users to edit workflows in a browser
Exercises part two (if you have access to a KNIME Server)
1. Upload one of your workflows and …
A. Schedule it to be executed in 5 minutes
B. Execute it stepwise using the Remote Workflow Editor
2. Download the Guided Automation Workflow from the KNIME Hub, deploy it to your server, and execute it from the KNIME WebPortal.
Solution: 1 = B; 2 = A; 3 = A; 4 = B and C; 5 = D and E
Webinars about the KNIME WebPortal:
- Guided Automation - A Blueprint for Interactive Automated Machine Learning
- Behind the Scenes of Guided Analytics
Blog Posts about REST