A rights group said the detention centre had refused one detainee access to a specialist doctor after he complained about chest pains.