Episode 12: Engineering Metrics and Team Effectiveness with Charity Majors
In Episode 12 of the Agile Engineering Podcast, we focus on engineering metrics and team effectiveness. Hosted by Liam Gulliver, Pete Gallagher, Louise Paling, Mica Bell, and Jonathan Relf. In this episode, they are joined by special guest Charity Majors, CTO of Honeycomb, and self-proclaimed ‘Agent of Chaos‘.
Charity brings a pragmatic perspective to the discussion. Firstly,she emphasises that engineering metrics serve as tools for discussions with management rather than to treat them as absolute truths. She argues that metrics, often abstract and imperfect, should not be regarded as holy or infallible. Instead, she suggests they should function as a shared language between human systems. Other panelists echo this sentiment, discussing how people can game metrics and stressing the importance of measuring the right behaviours. They also note that metrics alone cannot capture the full picture, making it crucial to understand the context.
Are engineering metrics telling us enough?
Charity further explains the role of engineering managers in understanding their teams beyond metrics. She advocates for balancing metric-driven approaches with human judgment. While metrics can guide decisions, they should not replace the nuanced understanding that comes from managing people. Additionally, the discussion highlights the value of team ownership of engineering metrics and goals, which ensures engagement and effectiveness. The discussion also emphasises comparing team performances to foster mutual learning rather than competition. As a result, they deem observability of teams and a focus on outcomes essential.
The episode concludes on the challenge of integrating metrics without compromising the human elements of management, underlining the need for a thoughtful approach to using metrics in team assessments.
Whether you’re an engineering manager, a team leader, or an individual contributor, this episode offers valuable insights. We hope you find actionable advice that can help refine your approach to measuring and improving team effectiveness. Join a discussion to challenge your perspectives and perhaps, like Charity Majors, urge you to embrace a little chaos!
Timestamps
- 00:00 Introduction to Agile Engineering Podcast
- 00:43 Introducing the Hosts and Special Guest
- 01:21 Charity Majors on Measurement and Metrics
- 03:10 Gaming the System: KPI and Metrics Challenges
- 05:30 Team Goals and Ownership
- 06:55 The Problem with Velocity and Story Points
- 15:09 Comparing Teams and Measuring Success
- 16:54 The Role of Engineering Managers
- 24:25 Unconscious Biases and Awareness
- 25:19 Engineering Leadership and Metrics
- 26:04 Balancing Data Collection and Utility
- 27:17 Gaming the System and Metrics
- 30:44 Observability vs. Monitoring
- 33:26 Human-Centric Metrics
- 35:53 Challenges in Measuring Performance
- 40:03 The Role of Metrics in Management
- 41:38 Personal Experiences with Metrics
- 46:26 Key Takeaways and Final Thoughts