The Fabulous World of Data – ETL Powered by Apache NiFi and Scrapy

Many data science and AI projects face a problem right at the start: how to collect and process the data that will form the basis for all further work? Which tool is suitable? In this session you will hear Bianca from SHI GmbH share her team’s experiences from many projects in this area and demonstrate hands-on how the two open source tools Apache NiFi and Scrapy can be used to efficiently collect and process data from various sources – each by their own or in combination.

Get a hands-on introduction to two open source ETL tools: Apache NiFi and Scrapy. You will learn how the tools work, what they can do and how you can benefit from them in your own data science, AI or search projects.

Speaker:
Bianca Geyer, Consultant Search & Analytics, SHI GmbH