The mortgage business is a feast-and-famine affair. The COVID-19 pandemic pushed the Federal Reserve to lower rates, which triggered an enormous refinancing boom. This gave the mortgage industry two fabulous years, in 2020 and 2021.