Adam for php.ini changes to take effect with OLS, the lsphp process for that website needs to be killed. For example adding auto_prepend_file property for Wordfence.
It seems that also waiting works. The lsphp processes seems to have a lifespan.
Reloading OLS does not work in this case.