Recognizing the risk
If we acknowledge that large language models could bring about
an age of poor-quality analysis and reasoning in the field of law,
then we can still protect ourselves.
Poor understanding of risk models contributed to the subprime
mortgage crisis in the 2000s – and it's arguable that
lawyers' overreliance on LLMs could lead to what might be
called a crisis of subprime thinking. It's up to us –
humans, lawyers, leaders - to design ways to guard against it.
The subprime precedent: a cautionary tale in the banking
industry
In the early 2000s, RiskMetrics (now part of MSCI) sold risk
models to banks, allowing them to evaluate the risk on their
balance sheets. Over time, banks began using those same models to
calculate the capital reserves required to maintain solvency
ratios. Those models were built by mathematical geniuses –
but based on data from a period when correlations in residential
mortgage lending were low. Under normal conditions,