Home › Forums › Debugging Spark Jobs in Databricks › Spark job

    Viewing 3 posts - 1 through 3 (of 3 total)
    • Author
      Posts
    • May 21, 2025 at 10:36 am #20315
      allison
      Participant

      I use the Spark UI to analyze stages and tasks. Look at skewed joins.

      May 21, 2025 at 10:37 am #20316
      allison
      Participant

      Also consider using .explain() to check your query plans. Helps a lot.

      May 21, 2025 at 10:38 am #20317
      JoshMathew
      Participant

      Does enabling adaptive query execution help? My job improved when I tried it.?????

      • This reply was modified 3 weeks, 4 days ago by JoshMathew.
    • Author
      Posts
    Viewing 3 posts - 1 through 3 (of 3 total)

    You must be logged in to reply to this topic. Login here