Profile Topics Started Replies Created Engagements Favorites Search replies: Forum Replies Created Viewing 4 posts - 1 through 4 (of 4 total) Author Posts May 23, 2025 at 9:25 am in reply to: What feature, concept, or workflow gave you the most trouble? #20373 allisonParticipant Managing libraries for my cluster threw me off. I wasn’t sure how to install packages correctly, especially external ones. May 21, 2025 at 10:54 am in reply to: Ask questions about billing, storage, and usage monitoring #20324 allisonParticipant Try materialized views for frequent queries. Also, monitor QUERY_HISTORY to find heavy queries. May 21, 2025 at 10:37 am in reply to: Spark job #20316 allisonParticipant Also consider using .explain() to check your query plans. Helps a lot. May 21, 2025 at 10:36 am in reply to: Spark job #20315 allisonParticipant I use the Spark UI to analyze stages and tasks. Look at skewed joins. Author Posts Viewing 4 posts - 1 through 4 (of 4 total)