Yep. Almost all pepper plants only need to be watered maybe once a week depending on the fruit size. Let it go without watering a few more days than you’d normally go, and see if the leaves flatten out a bit, then give it what you’d normally give it, and space out the waterings a bit more until it’s about a week between waterings.