Ongoing problem for months, randomly sending 500 errors to the client about once or more a week. Following is the error the client receives until zend is restarted via the 5250 emulator. Our server is an IBMi AS/400 running zendserver 7
Internal Server Error
The server encountered an internal error or misconfiguration and was unable to complete your request.
Contact the server administrator at [no address given] to inform them of the time this error occurred, and the actions you performed just before this error.
More information about this error may be available in the server error log.
Additionally, error 500 Internal Server Error was encountered while attempting to use ErrorDocument to handle the request.
The ONLY errors around the time the server quit responding we receive in the Apache logs is as below. Any other errors (in the PHP logs or zendserver logs) are not near the timestamp of when the server crashes. The error below is showing up repeatedly while the server is in trouble.
[Mon Feb 18 14:35:52.082696 2019] [ibm_ssl:error] [pid 230675:tid 00000401] ZSRV_MSG0251: Secure sockets handshake timed out, error = 6011.
[Mon Feb 18 14:35:52.082784 2019] [ibm_ssl:error] [pid 230675:tid 00000401] ZSRV_MSG0281: SSL: 69.213.8.13.
[Mon Feb 18 14:35:52.089664 2019] [ibm_ssl:error] [pid 230675:tid 000003DC] ZSRV_MSG0251: Secure sockets handshake timed out, error = 6011.
[Mon Feb 18 14:35:52.089680 2019] [ibm_ssl:error] [pid 230675:tid 000003DC] ZSRV_MSG0281: SSL: 69.213.8.13.
...
[Mon Feb 18 14:38:20.769832 2019] [zend_enabler:error] [pid 230675:tid 000003F3] Can not connect() to /usr/local/zendphp7/bin/php-cgi.bin (0.0) - [3425] A remote host refused an attempted connect operation.
[Mon Feb 18 14:38:20.887512 2019] [zend_enabler:error] [pid 230675:tid 000003DE] Can not read response from /usr/local/zendphp7/bin/php-cgi.bin (0.0) - [3447] A remote host did not respond within the timeout period.
[Mon Feb 18 14:38:24.841288 2019] [zend_enabler:error] [pid 230675:tid 000003F5] Can not read response from /usr/local/zendphp7/bin/php-cgi.bin (0.0) - [3447] A remote host did not respond within the timeout period.
[Mon Feb 18 14:38:25.964048 2019] [zend_enabler:error] [pid 230675:tid 000003E1] Can not read response from /usr/local/zendphp7/bin/php-cgi.bin (0.0) - [3447] A remote host did not respond within the timeout period.
[Mon Feb 18 14:38:25.964528 2019] [zend_enabler:error] [pid 230675:tid 000003E1] Can not connect() to /usr/local/zendphp7/bin/php-cgi.bin (0.0) - [3425] A remote host refused an attempted connect operation.
[Mon Feb 18 14:38:25.966320 2019] [zend_enabler:error] [pid 230675:tid 000003E1] Can not connect() to /usr/local/zendphp7/bin/php-cgi.bin (0.0) - [3425] A remote host refused an attempted connect operation.
[Mon Feb 18 14:38:25.966600 2019] [zend_enabler:error] [pid 230675:tid 000003E1] Can not connect() to /usr/local/zendphp7/bin/php-cgi.bin (0.0) - [3425] A remote host refused an attempted connect operation.
The following is the status of the zend related jobs while the server is sending 500 errors
ZENDPHP7 QTMHHTTP BCH .0 PGM-QZHBMAIN SIGW
ZENDPHP7 QTMHHTTP BCI .0 PGM-QZSRLOG SIGW
ZENDPHP7 QTMHHTTP BCI .0 PGM-QZSRLOG SIGW
ZENDPHP7 QTMHHTTP BCI .0 PGM-QZSRHTTP SIGW
ZENDPHP7 QTMHHTTP BCI .0 PGM-zfcgi SELW
ZENDPHP7 QTMHHTTP BCI .0 PGM-php-cgi.bi THDW
ZENDPHP7 QTMHHTTP BCI .0 PGM-php-cgi.bi THDW
ZENDPHP7 QTMHHTTP BCI .0 PGM-php-cgi.bi TIMW
ZENDPHP7 QTMHHTTP BCI .0 PGM-php-cgi.bi TIMW
ZENDPHP7 QTMHHTTP BCI .0 PGM-php-cgi.bi TIMW
ZENDPHP7 QTMHHTTP BCI .0 PGM-php-cgi.bi TIMW
ZENDPHP7 QTMHHTTP BCI .0 PGM-php-cgi.bi TIMW
ZENDPHP7 QTMHHTTP BCI .0 PGM-php-cgi.bi SELW
ZENDPHP7 QTMHHTTP BCI .0 PGM-php-cgi.bi TIMW
ZENDPHP7 QTMHHTTP BCI .0 PGM-php-cgi.bi SELW
ZENDPHP7 QTMHHTTP BCI .0 PGM-php-cgi.bi TIMW
ZENDPHP7 QTMHHTTP BCI .0 PGM-php-cgi.bi TIMW
ZENDPHP7 QTMHHTTP BCI .0 PGM-php-cgi.bi TIMW
ZENDPHP7 QTMHHTTP BCI .0 PGM-php-cgi.bi TIMW
ZENDPHP7 QTMHHTTP BCI .0 PGM-php-cgi.bi TIMW
ZENDPHP7 QTMHHTTP BCI .0 PGM-php-cgi.bi TIMW
ZENDPHP7 QTMHHTTP BCI .0 PGM-php-cgi.bi TIMW
ZENDPHP7 QTMHHTTP BCI .0 PGM-php-cgi.bi TIMW
ZENDPHP7 QTMHHTTP BCI .0 PGM-php-cgi.bi TIMW
ZENDPHP7 QTMHHTTP BCI .0 PGM-php-cgi.bi TIMW
ZENDPHP7 QTMHHTTP BCI .0 PGM-php-cgi.bi TIMW
ZENDPHP7 QTMHHTTP BCI .0 PGM-php-cgi.bi TIMW
ZSDEPLMNG QTMHHTTP BCI .0 PGM-watchdog THDW
ZSDEPLMNG QTMHHTTP BCI .0 PGM-zdd RUN
ZSJAVA_BRG QTMHHTTP BCI .0 PGM-watchdog THDW
ZSJAVA_BRG QTMHHTTP BCI .0 PGM-jFromPASE EVTW
ZSJAVA_BRG QTMHHTTP BCI .0 JVM-com.zend.j SELW
ZSMONMNG QTMHHTTP BCI .0 PGM-watchdog THDW
ZSMONMNG QTMHHTTP BCI .0 PGM-MonitorNod SELW
No idea where to go from here, google has not been helpful.
