I'm not aware of a ready-made solution for any of these formats. POI can read XLS, but it's up to the developer to create PDF from that. POI also can read Word documents, but that's reported to be buggy and unsupported, so it may or may not work with the files you have. For RTF, you could write a reader based on the JavaCC parser (which comes with an RTF grammer). All of these would require significant amounts of work.
One other options might be OpenOffice and its Java API, which is largely undocumented from what I understand. A starting point might be this article:
http://weblogs.java.net/blog/tchangu/archive/2005/12/open_office_jav_1.html