Lazily get user context if we should be able to (#152)

Lazily get user context if we should be able to (#152) #111