Skip to main content

Real-Time Intelligence

New

Enhanced Memory Metrics for Spark Streaming Jobs in Fabric

Vote (1) Share
Shyam Prasad's profile image

Shyam Prasad on 30 Jan 2025 17:46:40

hhhhhhhh

Comments (1)
Shyam Prasad's profile image Profile Picture

Shyam Prasad on 30 Jan 2025 18:40:17

RE: Enhanced Memory Metrics for Spark Streaming Jobs in Fabric

In Spark Streaming jobs running on Fabric capacity, there are currently no built-in metrics, graphs, or dashboards to display executor memory details such as free memory, consumed memory, and total memory. Providing these insights would help end users make informed decisions about scaling their environment type or workload based on resource utilization