PySpark

In this getting started, we will set up a PySpark project and learn how to build and deploy it on Conveyor.

📄️ 1. Create a new PySpark project

Create your PySpark project

📄️ 2. Create a new environment

The environment is the place where your project will run

📄️ 3. Deploy your project

Running your project on an environment

📄️ 4. Set up your project locally

Setting up your computer

📄️ 5. Add and configure project resources

Configuring a cloud role for your project

📄️ 6. Run against real data

Adding your own code to your project

📄️ 7. (Optional) Check out PySpark streaming

Configure PySpark streaming for your project

📄️ 8. Clean up

Remove all deployed resources