As a business owner, the easiest thing to forget about is taxes, especially when you are starting out. Making estimated tax payments is how you can avoid expensive penalties, and interest, that you would otherwise owe to the IRS.
If you are unsure about your need to pay estimated income taxes, this flowchart is a starting point. After working through the flowchart, consult with your accountant on what to do next.