Skip to main content

Real-Time Intelligence

New

Enhanced Memory Metrics for Spark Streaming Jobs in Fabric

Vote (1) Share
Shyam Prasad's profile image

Shyam Prasad on 30 Jan 2025 18:43:03

In Spark Streaming jobs running on Fabric capacity, there are currently no built-in metrics, graphs, or dashboards to display executor memory details such as free memory, consumed memory, and total memory. Providing these insights would help end users make informed decisions about scaling their environment type or workload based on resource utilization