This video is still being processed. Please check back later and refresh the page.

Uh oh! Something went wrong, please try again.

Apache Spark 3 Essentials

Apache Spark 3 puts innovation in the hands of developers w/ Pandas UDFs, join optimizer hints, dynamic partition pruning, GPU-aware scheduler, and more

Cancel Apply

rate limit

Code not recognized.

About this Course

Apache Spark 3 Essentials begins with a short review of Apache Spark, covering core functionality and listing benefits of near real-time streaming. Next are the most notable Spark 3 features and improvements, such as Pandas UDFs, join optimizer hints, dynamic partition pruning, a GPU-aware scheduler, and a new structured streaming UI. End with use cases showing the variety of ways Spark can be deployed.

What's Covered

Brief History of Apache Spark

  • Brief overview of Spark 3
  • What does Apache Spark 3 support?
  • What can Apache Spark 3 be used for?
  • Environments, languages, libraries, and more.

Apache Spark 3 Features

  • Adaptive query execution
  • Dynamic partition pruning
  • JOIN optimizer hints
  • Pandas UDF improvements
  • Structured streaming UI
  • SQL compatibility
  • GPU-aware scheduler

Use Cases

  • Energy
  • Finance
  • Government
  • Healthcare
  • Agriculture
  • Entertainment

Curriculum24 min

  • Preview
    Course Topics 1 min
  • Brief History of Apache Spark 5 min
  • Apache Spark 3 Features 10 min
  • Apache Spark Use Cases 8 min
  • Quiz
  • Related Content
  • Blogs, articles, developer stuff
  • Get more Apache Spark Training

About this Course

Apache Spark 3 Essentials begins with a short review of Apache Spark, covering core functionality and listing benefits of near real-time streaming. Next are the most notable Spark 3 features and improvements, such as Pandas UDFs, join optimizer hints, dynamic partition pruning, a GPU-aware scheduler, and a new structured streaming UI. End with use cases showing the variety of ways Spark can be deployed.

What's Covered

Brief History of Apache Spark

  • Brief overview of Spark 3
  • What does Apache Spark 3 support?
  • What can Apache Spark 3 be used for?
  • Environments, languages, libraries, and more.

Apache Spark 3 Features

  • Adaptive query execution
  • Dynamic partition pruning
  • JOIN optimizer hints
  • Pandas UDF improvements
  • Structured streaming UI
  • SQL compatibility
  • GPU-aware scheduler

Use Cases

  • Energy
  • Finance
  • Government
  • Healthcare
  • Agriculture
  • Entertainment

Curriculum24 min

  • Preview
    Course Topics 1 min
  • Brief History of Apache Spark 5 min
  • Apache Spark 3 Features 10 min
  • Apache Spark Use Cases 8 min
  • Quiz
  • Related Content
  • Blogs, articles, developer stuff
  • Get more Apache Spark Training

For more information on how HPE manages, uses and protects your information please refer to HPE Privacy Statement. You can always withdraw or modify your consent to receive marketing communication from HPE. This can be done by using the opt-out and preference mechanism at the bottom of our email marketing communication or by following this link.

×
​ ​ ​
​