Spreadsheet: A table of rows and columns, free for the entry of data, or formulae for calculating actions on those data. Each row or column is said to contain many 'cells' and these cells serve as 'homes' for every shred of information.
Most spreadsheet applications have built in formulas and functions that will do the math for you so you don't have to. You can keep a running balance of your accounts and you can have each category totaled as well. You can keep it as simple or make it as sophisticated as you please.
If you have Microsoft Excel, you can create budgeting spreadsheets to help you manage your money. Instead of buying expensive software that will only be used for your budget, spreadsheets can be used for a variety of tasks. If you don't have Excel, you can find free spreadsheet applications online in which to manage your budget.
You may want to create a workbook with multiple sheets for various aspects of your budget. You can have one sheet that keeps track of savings and investments and another sheet that lists your monthly bills.