Maurizio Garro

Senior Manager, Market, Credit & Risk Lloyds Banking Group

Maurizio Garro is the Senior Audit Manager of Lloyds Banking Group in the Model, Market and Credit risk team.

He spent over 4 years in KPMG to lead the delivery of advanced quantitative methodologies for market and credit risk (including AI/learning machine), and in UniCredit for 6 years to lead the development of models for commercial banking activities, securitizations and trading on stocks and forex.

Maurizio is a  frequent speaker on various topics in risk management, and a member of the Institute of Internal Auditor and the Global Association of Risk Professional – FRM.

He holds a Masters in Economics and Quantitative Finance, gained at Bocconi University.

Conference Day Two: 17 September 2019

Tuesday, September 17th, 2019

4:15 PM Panel: When ML doesn't work as expected, what went wrong and how can you recover?

Session preview:
Given the intrinsic complex and dynamic nature of the machine learning (ML) the possibility of failure does not come like a surprise.

There are many reasons why this can happen. One of them is the biases in the training data and method (e.g. sampling, data preparation). Another reason is that the ultimate scope of the ML is not well defined and transparent. Further issues are linked to the machine learning techniques which are not able to inform us when the information is not clear or they cannot effectively learn from the data. Finally, ML uses a high number of hyper parameters (e.g. how many trees I consider in a decision process like random forest). These hyper parameters are defined by the developer and they cannot be derived by the data. 

Of course perfection always starts with mistakes. So, how can we make the ML a better place? Of course, the starting point is the data.

First of all, it is important that data is accurate, complete and sufficient to extract statistically significant insights. Data inputs must be interpretable, coherent with the internal policy of the firms and give a business rationale. In addition, we need to have a robust approach to pre-process the data to avoid any corrupted learning processes. 

Another important point is the calibration. As we know, this is a crucial part for the traditional models and it is even more important for ML given the amount of parameters, data and the frequency they are updated. In this case, we can establish specific controls to assess if the calibration is appropriate and develop a monitoring framework including thresholds and triggers to inform if the model is working as expected. Of course, the above requires some changes in the way we review model risk for ML. First of all, we need to review the model risk policy to reflect the features of the ML discussed above. Secondly, the validators must be sure they are equipped with the right tools to deal with the big data and computation complexity behind the ML exploit. - Maurizio Garro, Senior Manager, Market, Credit & Risk, Lloyds Banking Group

Check out the incredible speaker line-up to see who will be joining Maurizio.

Download The Latest Agenda