It is crucial for business leaders to understand the limitations and potential pitfalls of current approaches to measuring AI capabilities.