Retailers are worried that inflation and fear of a potential recession will impact holiday spending.