Skip to main content

Ctrl+K

Site Navigation

Overview
Getting Started
User Guides
API Reference
Development
Migration Guides

GitHub
PyPI

Site Navigation

Overview
Getting Started
User Guides
API Reference
Development
Migration Guides

GitHub
PyPI

Section Navigation

Spark SQL
Pandas API on Spark
Structured Streaming
MLlib (DataFrame-based)
MLlib (DataFrame-based) for Spark Connect
Spark Streaming (Legacy)
MLlib (RDD-based)
Spark Core
Resource Management
Errors
Testing
- pyspark.testing.assertDataFrameEqual
- pyspark.testing.assertSchemaEqual

API Reference
Spark Core
pyspark.BarrierTaskContext.stageId

pyspark.BarrierTaskContext.stageId#

BarrierTaskContext.stageId()#

The ID of the stage that this task belong to.

Returns

int: current stage id.

previous

pyspark.BarrierTaskContext.resources

next

pyspark.BarrierTaskContext.taskAttemptId

Copyright @ 2024 The Apache Software Foundation, Licensed under the Apache License, Version 2.0.

Created using Sphinx 4.5.0.

Built with the PyData Sphinx Theme 0.13.3.