BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//DevOpsChat//Events//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
BEGIN:VEVENT
UID:01a1989d-2ca4-7235-b0e5-080f198ae1a0@www.devopschat.co
DTSTAMP:20261106T142755Z
DTSTART:20200922T080000Z
DTEND:20200922T090000Z
SUMMARY:Making Apache Spark on Kubernetes stable and performant at scale
DESCRIPTION:** PLEASE REGISTER HERE **\nhttps://trifork.zoom.us/webinar/reg
 ister/WN_UUFKKiKmSKqAfZgBIrNIXA\n\nABOUT THE TALK\n\nApache Spark can nati
 vely run on top of Kubernetes (as a replacement of Hadoop YARN) since Spar
 k 2.3 (2018). There are many benefits to running Apache Spark on Kubernete
 s\, including the native containerization and cloud-provider abstraction\,
  the integration with the rest of the Kubernetes ecosystem\, and significa
 nt cost savings enabled by the superior efficiency in resource sharing.\n\
 nDespite a growing interest and adoption from the community\, making Spark
  on Kubernetes performant and stable remains a challenge for most companie
 s. In this talk\, we will walk you through an example data pipeline in PyS
 park running on Kubernetes\, and give you tips and best practices to get s
 tarted with Apache Spark on Kubernetes. Topics include: - Core concepts of
  Spark on Kubernetes - App-level dynamic allocation and cluster-level auto
 scaling - How to get the maximum performance out of shuffle stages (all-to
 -all data exchanges) - Monitoring and security best practices on Kubernete
 s - Limitations of Spark and Kubernetes and planned future works.\n\nAgend
 a\n17.00: Welcome to this GOTO Night with Jean-Yves Stephan\n17.05: Jean-Y
 ves Stephan will give his talk Kubernetes\n17.45: Live Q&A with Jean-Yves 
 Stephan\n17.55: Thank you for joining us for this GOTO Night\n\nABOUT THE 
 SPEAKER\n\nJean-Yves is the co-founder of Data Mechanics\, a YCombinator s
 tartup building a serverless platform for Apache Spark. Prior to that\, he
  was a software engineer and the Spark infrastructure lead at Databricks\,
  the data science platform founded by the creators of Apache Spark. JY is 
 passionate about making Spark and distributed data engineering 10x more ea
 sy-to-use and performant.\n\n** PLEASE REGISTER HERE **\nhttps://trifork.z
 oom.us/webinar/register/WN_UUFKKiKmSKqAfZgBIrNIXA\n\nhttps://www.devopscha
 t.co/meetings/making-apache-spark-on-kubernetes-stable-and-performant-at-s
 cale
URL:https://www.devopschat.co/meetings/making-apache-spark-on-kubernetes-st
 able-and-performant-at-scale
END:VEVENT
END:VCALENDAR