Two small cliffs with some fun moderate routes. See climbri.com/ for more info.
Take Route 44 west. Take a left on Route 94 (Reynolds Road). Go for about a mile and a half. Pass the brown sign and parking lot for the Durfee Hill Management Area. Park at the next pull-off on the left. Walk diagonally left (south) crossing the road. You will see a well-defined path on west (right) side of the road. Follow it to the crag which is only a hundred feet or so from the road.
Mountain Project's determination of some of the classic, most popular, highest rated routes for Durfee Hill:
By M Sprague Administrator From: New England Dec 22, 2010
This crag has some really nice rock. Unfortunately, it is just at that height where it is short enough that it feels like a pain to keep setting up and moving TRs, but you really don't want to fall when soloing, even with pads. It is well worth a visit if you live relatively near by. Wear your orange around hunting season.
Last I knew, there is a small bolted area nearby, off Yosemite Road, just over the border into CT, with some fun, short pocket routes, including CT's first 5.13. I believe it was to the north of the road, over a ridge line. Unfortunately, it is/was on private property which got posted, so became off limits. I haven't been there in many years, so it could be covered in houses now for all I know. It might be worth going to see what the current situation is.
The crag you refer to on Yosemite Valley Road in Dayville is heavily posted. There is a No Trespassing sign every 20 feet. It's too bad as it is a decent cliff. I have an old photo of Whitey climbing on the 5.9 arete.
It was posted no trespassing when we climbed there, I seem to remember someone just taking down a bunch of the no trespassing signs and pleading ignorance. The end of climbing there for me, came when we got chased out by a couple german shepards and an angry neighbor who set them on us...