I had a look on Ancestry and they show a Comfort Olley aged 43, born 1786 buried 22 Nov 1829 in St Alphage, Greeenwich, Kent. I also notice with interest that John Olley had several daughters and they had Comfort as a second name. Some may have been daughters of John jnr. etc. Hester Comfort Olley bapt 1824 St Alfege Hester appears to have died shortly after baptism as both a baptism and burial were in May 1824 Rebecca Comfort Olley bapt 1826 St Alfege Also John Olley and Rebecca had Maria Comfort Olley bapt 17DEC1837 St Alfege And Thomas Olley and Elizabeth had Elizabeth Comfort Olley in 1847.
The Norwich connection is interesting as Norwich was one of the oldest brushmaking towns and there are many links back to the area, including Doughty brushmakers who came to London to work in the Borough, which was the main brushmaking area of London.
I don't know where you are located, but I know Greenwich very well as my family lived in the area and I often used to visit them. My ggf lived near Greenwich Church (St Alfege) so he was not far from the bridge. My parents were both living in Greenwich when they met. My father was born there and also lived near the church with his mother. my parents later lived in Friendly Street, which is in Deptford. http://www.ideal-homes.org.uk/lewisham/assets/galleries/deptford-new-town/friendly-streethttp://www.ideal-homes.org.uk/lewisham/assets/galleries/deptford-new-town/friendly-street
If you click the link to the map you will see that Friendly Street is not far from Deptford Bridge. This was a bridge over the Ravensbourne river which enters the Thames at Creek Bridge near Greenwich church. This modern map shows Greenwich High Road. http://www.maps11.com/London/map_f/Friendly+Street+SE8.htmlhttp://www.maps11.com/London/map_f/Friendly+Street+SE8.html My ggf lived in Straitsmouth which is where Greenwich Station is. This explains why locals became involved in the railways. The Deptford to London Bridge line was one of the first built in London - 1836. A stop at Greenwich was built later that year and the station building at Greenwich built in 1840.