Prior to the CRoW Act, the local farmer banned climbing, citing an incident where gates were left open and stock escaped onto the road. Since the implimentation of CroW however, much of the crag is accessible.
The area where climbing remains forbidden is (within) the prominent drystone wall above the farm complex shown as Shillafield on the 1:50,000 map. (This is not the farm directly below the Pennine Way 'notch').
Climbers have on occassion been told by an unidentified farmer/shepherd that they cannot climb on the crag west of the drystone wall, this is not the case as these rocks are on open access land.
It is worth checking the Natural England open access land maps on line to check for any local restrictions. In the absence of any, then climbing west of the wall is allowed.
Open access land, designated under the Countryside & Rights of Way Act (2000) give area access rather than linear access as provided by public rights of way. It also gives a legal right of access specifically for climbing, as well as walking and other quiet recreation on foot.
Please bear in mind however that the landowner still has the right to restrict access for up to 28 days per year (often used on public safety grounds for shooting in moorland areas), and can also apply for longer term restrictions with Natural England (such as bans on dogs, or regular restrictions during particular times of year). It is important to check for these restrictions regularly as they can be added at short notice – all details for open access land in England can be found on Natural England’s website.