You won't find a civil birth record for him because Virginia wasn't recording births that early. You might find a church record at the Henrico County historical or genealogical society.
Married: 22 Jan 1803, Chesterfield Co. VA
Source: Virginia Marriages 1785-1940; no actual doc in FamilySearch
Married: 5 May 1841, Chesterfield Co., VA
Polly Frost, b. 1820
F: Joshua Frost
Source: same as above
I'd order copies of these marriage docs from the Archives, www/va.virginia.gov/chancery/available.org because his parents names might be on them.
I'd also look in the local newspapers for his marriage announcement. Library of congress, Chronicling America has old, digitized, free newspapers online.
I'd contact the Chesterfield Historical Society of Virginia, www.chesterfieldhistory.com/CHSVLibrary.html
and Chesterfield County Public Library, http://library.chesterfield.gov/topics/genealogy/
and ask if they have a local, early death index, indexed death notices and cemetery inventories. His parents names might be in his death notice. Successful Searching!