About the webinar
Sammy El Khammal
Spark is powerful in transforming, organizing, and moving data. Still, it can leave data teams blind when it comes to data reliability. With our expert, you will discover how to monitor the health of a data pipeline within Spark when jobs are running so you get immediate observability.
Watch this webinar to understand how the Kensu spark agent can collect real-time insights about the data and send it to the Kensu platform to detect a data issue in a pipeline, find its root cause, and prevent future garbage in/garbage out.
What you will learn
- Include a spark agent in a scala and pyspark application
- Use Kensu Profiler to monitor the health of the pipeline
- Find the root cause of a data issue using the Explorer
- Prevent new data issues thanks to circuit breakers