Well, for the license, you'd probably want to go to your local Commissioner of Revenue (who is usually in charge of commerce and business licenses). Barring that, City Hall is a good place to start. I live in a small town myself, and it took me about two weeks of popping in and out of government offices to find out what the procedure was, but eventually someone who knew the process pointed me in the right direction.
As to the small business grant... I hate to disappoint you in the same way that I was once disappointed, but there is no such thing as a small business grant despite all the people that talk about them. There are, however, loan programs and other options offered by the Small Business Administration. Here's a good launching point to start from (and a confirmation that the United States doesn't do small business grants):
http://app1.sba.gov/faqs/faqindex.cfm?areaID=19
Best of luck!
