Announcing AWS Glue serverless Spark UI and observability metrics

Announcing general availability of two new capabilities to enhance monitoring and debugging of AWS Glue jobs: AWS Glue serverless Apache Spark UI and AWS Glue observability metrics. AWS Glue serverless Spark UI is a new capability that enables you to get detailed information about your AWS Glue Spark jobs. This launch allows you to see the details of any AWS Glue Spark job run in AWS Glue Studio. With AWS Glue serverless Spark UI, you can get information about scheduler stages, tasks, and executors. AWS Glue observability metrics provide additional insights into job reliability, performance, throughput and resource utilization. These two new capabilities enables you to debug common error classes with root cause, analyze aggregate worker performance, and monitor data skews in your Glue jobs.

Source:: Amazon AWS