Quick Question on penalties for late payment

Here's my story: big income in 2004, earned 41K refund from IRS: Taxes withheld from my payment. Idid not file taxes and left overpayment with IRS.
2005: much lower income due to new job. Did not file taxes or make payments. 2006: average income, filed taxes and made payment on time in early 2007. 2007: finally filed for 2004 (41K refund) and for 2005 (owed $11K) PROBLEM: IRS is hitting me up for almost 5K in penalties and interest for late payment in 2005. I point out they had $41K of my money throughout 2004 - 2007 which I did not take out, so no interest can possibly be due. They say 2004 and 2005 are treated separately at IRS, and my overpayment and credit with them mean nothing for 2005. Any ideas on how / who to go to at IRS to get my interst and/or interest for 2005 waived? Doesn't seem fair to me. Thanks! JayJerry
<< ------------------------------------------------------- >> << The foregoing was not intended or written to be used, >> << nor can it used, for the purpose of avoiding penalties >> << that may be imposed upon the taxpayer. >> << >> << The Charter and the Guidelines for submitting posts >> << to this newsgroup as well as our anti-spamming policy >> << are at www.asktax.org. >> << Copyright (2006) - All rights reserved. >> << ------------------------------------------------------- >>
Add pictures here
<% if( /^image/.test(type) ){ %>
<% } %>
<%-name%>
Add image file
Upload

If you have cashed your refund check for 2004, you are out of luck. However, if you have not, you can send it back with a note that you want it applied to 2005. They will not apply a refund unless asked.
<< ------------------------------------------------------- >> << The foregoing was not intended or written to be used, >> << nor can it used, for the purpose of avoiding penalties >> << that may be imposed upon the taxpayer. >> << >> << The Charter and the Guidelines for submitting posts >> << to this newsgroup as well as our anti-spamming policy >> << are at www.asktax.org. >> << Copyright (2006) - All rights reserved. >> << ------------------------------------------------------- >>
Add pictures here
<% if( /^image/.test(type) ){ %>
<% } %>
<%-name%>
Add image file
Upload

BeanSmart.com is a site by and for consumers of financial services and advice. We are not affiliated with any of the banks, financial services or software manufacturers discussed here. All logos and trade names are the property of their respective owners.

Tax and financial advice you come across on this site is freely given by your peers and professionals on their own time and out of the kindness of their hearts. We can guarantee neither accuracy of such advice nor its applicability for your situation. Simply put, you are fully responsible for the results of using information from this site in real life situations.