Roller lifters do not roll well if they are turned. That can happen if the yoke somehow fails.
Do you have any debris in the oil? That can quickly confirm if you have something wrong internally such as a cam bearing, lifter, rocker, piston, etc. If you do check the material (alum, steel/iron...