Course Outline
Introduction
Overview of Apache Spark Features and Architecture
- Apache Spark modules: Spark SQL, Spark Streaming, MLlib, GraphX
- RDD, Dataframes, drive-workers, DAG, etc.
Setting up Apache Spark on .NET
- Preparing the Java VM
- Running .NET for Apache Spark using .NET Core
Getting Started
- Creating a sample .NET console application
- Adding the Spark driver
- Initializing a SparkSession
- Executing the application
Preparing Data
- Building a data preparation pipeline
- Performing ETL (Extract, Transform, and Load)
Machine Learning
- Building a machine learning model
- Preparing the data
- Training a model
Real-time Processing
- Processed streaming data in real-time
- Case study: monitoring sensor data
Interactive Query
- Working with Spark SQL
- Analyzing structured data
Visualizing Results
- Plotting results
- Using third-party tools to visualize results
Troubleshooting
Summary and Conclusion
Requirements
- .NET programming experience using C# or F#
Audience
- Developers
Testimonials (10)
I liked that it was practical. Loved to apply the theoretical knowledge with practical examples.
Aurelia-Adriana - Allianz Services Romania
Course - Python and Spark for Big Data (PySpark)
A lot of practical examples, different ways to approach the same problem, and sometimes not so obvious tricks how to improve the current solution
Rafał - Nordea
Course - Apache Spark MLlib
This is one of the best hands-on with exercises programming courses I have ever taken.
Laura Kahn
Course - Artificial Intelligence - the most applied stuff - Data Analysis + Distributed AI + NLP
Just the overall exposure. Very helpful.
Travis - Beckman Coulter
Course - Introduction to Blazor
The trainer was very helpful answering any questions we had and let us share our screen to show the errors we were having which was great.
chithra - Public Health Wales NHS Trust
Course - Advanced Blazor
Question and answer. And project demonstration.
Qing - Ametek
Course - Implementing the Actor Model with Microsoft Orleans
It took up good stuff with a good speed, and not stayed in areas that was not important, left that to the student when the course was over. I mean that for a 2 day course it is a good value.
Mikael Forsberg - Kvadrat Örebro AB
Course - Introduction to .Net Core
The trainer explained the subjects very good with actual examples from real world which made it simpler for us to grasp the information
Florin-Viorel Marut - Continental Automotive Romania
Course - High-Performance Application Development with .NET Core
Very hands on knowledge on the subject. A little bit of theory at the beginning to set the stage.
Thibault Chappuis - Mikron SA Boudry
Course - Entity Framework Core 2.0
Time management of the training. Allocated time of training was well-spent and maximized.