Rogers was born in Bridgehampton on August 1, 1787 and grew up on his family farm. At 16, he became an apprentice shipbuilder in Hudson, NY, where he began to develop his artistic skills drafting ship models. However, he soon suffered a severe cut to the knee that ended his shipbuilding career. Rogers returned home to recuperate under the care of Dr. Samuel H. Rose, who gave him a set of watercolors and brushes and encouraged his interest in art while he recovered.

Rogers moved to New York City in 1806, hoping to enhance and hone his artistic skills. In 1811 he began a year-long apprenticeship under artist Joseph Wood after which the 24-year-old Rogers opened his own studio where he quickly found early success as a prominent miniature portraitist of his day.

 
Nathan, as he was known by his family and friends married Caroline Dennison in 1817, the same year he began showing his work at the Academy of Fine Arts. In 1825 he became one of the founding members of the National Academy of Design.