Apache2 Picking Up Server IP for Users from Nginx Proxy

[mojeda]

Hello, I have multiple websites setup on different IPs. I am seeing connections from my server's IP in the apache2 logs for the domain the IP belongs to, however it is not happening to all log entries. Some are showing their real ip however it is mostly showing my the IP of the nginx proxy for the domain.

I have set_real_ip_from IP ADDRESS; With real_ip_header X-Real-IP; in my /etc/nginx/nginx.conf in the http section but it doesn't seem to really be working.