Working with Apache Spark
Add custom jar for Spark / PySpark jobs
Description
Configure fine-grained S3 access for Spark / PySpark jobs
Description
Configure Apache Iceberg for Spark / PySpark jobs
Description
Configure logging in Spark jobs
Description
Improve Spark efficiency
Recently, we released a new feature that analyzes the efficiency of your Spark jobs.
Improve Spark performance
This section contains some performance improvements you can employ for your Spark jobs.
Using AWS Glue with Spark 4.x
Spark 4.x is a major release with several breaking changes.